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I. INTRODUCTION 

A. PURPOSE 

The purpose of this thesis 1s to provide the necessary information to determine 
how a model Balanced Scorecard [Ref. 1] can be developed from performance 
measurement and continuous improvement monitoring at the Naval Dental Center in 
Pearl Harbor, Hawaii. Such a model could be used as a strategic management tool at 
other Naval Dental Centers. 
B. BACKGROUND 

Measures of strategic performance are vital to the future of all organizations 
whether governmental or non-governmental. Strategic management decisions should be 
made with regard to these performance measures. Financial measures of performance 
can provide information on past accomplishments but these alone are usually not 
sufficient to aid in long term management. The Balanced Scorecard, a concept developed 
by Robert S. Kaplan and David P. Norton, adds three other areas of performance 
measures that organizations should monitor, in addition to financial measures, as a tool 
for management. These three areas are customers, internal business processes, and 
learning and growth. Although the Balanced Scorecard was intended for profit-oriented 
organizations, its concepts have been applied to non-profit organizations, such as 
government agencies as well. [Ref. 1 and 2] 

In fact, as part of the National Performance Review and Re-invention programs of 
the Clinton administration, Congress enacted a law in 1993, the Government 
Performance and Results Act (GPRA), which has concepts similar to the Balanced 


Scorecard approach to management. Federal managers, who must already monitor their 
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financial management practices must also "focus on results, service quality, and customer 
satisfaction” and "improve internal management of the federal government". [Ref. 3] 

A government service organization that will be the focus of this thesis is the 
Naval Dental Center Pearl Harbor (NDCPH), Hawaii. It is a service organization whose 
mission is to provide comprehensive dental services to approximately 20,000 active duty 
Navy and Marine Corps personnel stationed, home ported, or in transit in the state of 
Hawaii. The NDCPH command consists of five branch dental clinics and a headquarters 
command all situated on the island of Oahu. The main branch clinic and the Headquarters 
Command are co-located in Pearl Harbor. This is the largest branch clinic by far and 
provides a comprehensive array of dental services. The other four branch clinics are 
smaller and provide more limited services in different locations on Oahu. Although not in 
direct competition, the US Army and Air Force also have dental clinics on the island of 
Oahu and provide dental care for their respective military personnel. 

NDCPH is directed by higher authority, the Navy Bureau of Medicine and Surgery 
(BUMED) to measure and report its operating performance, as 1s any federal 
organization. BUMED mandates certain performance measures that are common to all 
Naval Dental Centers in the United States and worldwide. Other performance measures 
are developed locally and may depend on command strategies or customer desires. 

In 1998 the leadership of NDCPH, proud of the command's measures of 
organizational performance and desiring outside validation of its efforts, learned of a 
state Chamber of Commerce award called the Hawai State Award of Excellence 
(HSAE). This award offered a non-military validation of NDCPH's performance efforts. 


NDCPH pursued the HSAE. 


In 1998, NDCPH was one of three organizations in Hawaii presented with the 
"Hawaii State Award of Excellence" (HSAE). This award is based on the criteria 
developed by the "Malcolm Baldridge National Quality Award" [Ref. 4] and is presented 
to organizations which have been undergone a rigorous evaluation and found to 
demonstrate exceptional standards of organizational excellence. The criteria for the 
award is also very similar to the criteria for Kaplan and Norton's Balanced Scorecard and 
the U.S. government's GPRA, specifically measuring performance through customer 
satisfaction, internal management and business processes, employee improvement, and 
financial measures. 

C RESEARCH OBJECTIVE 

The objective of this thesis is to analyze performance measures at NDCPH and 
evaluate how they fit into a Balanced Scorecard model and GPRA standards. Specific 
attention will be shown to data that was gathered for the HSAE award, which could be 
considered as benchmarks, and data gathered during a twelve-month period following the 
award. 

Also important to note is that a scheduled change in command occurred after the 
HSAE data was submitted. Changes inherent in new leadership should also be reflected 
in performance measures whether due to changes in business processes, strategies or 
managerial style. Any positive changes in performance measures could be an indicator of 
continuous success in meeting the mission. New business processes, positive trending (or 
even negative trending) performance measures and other success stories could be shared 
among other dental centers as part of a larger continuous improvement effort. Efficiency 


in care delivery could reduce the cost of care as well as the cost of lost man-hours from 
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work and deployment. Finally, increased patient satisfaction could lead to less missed 
appointments and fewer complicated dental patients who had been avoiding treatment. 
D. RESEARCH QUESTIONS 

The primary research question is: How can a Balanced Scorecard model of 
performance measurement be applied to NDCPH? 

Secondary, supportive research questions are: 


1. How can this model be applied to other Naval Dental Center's as a tool for 
strategic management? 


2. Would this Balanced Scorecard provide evidence of complicity of a 
Government organization to the GPRA? 


3. Who are the customers and stakeholders of performance at NDCPH? 


4. What performance measures were in place when NDCPH won the Hawaii 
State Award of Excellence (HSAE) and afterward? 


5. What was the criteria for the HSAE and is there a relationship to the Balanced 
Scorecard? 


6. What continuous improvement efforts followed the award and why? 


7. What effect did new leadership have on NDCPH's managerial strategy and 
performance measures? 


E. SCOPE OF RESEARCH 

This thesis includes a complete review of the pre- and post- HSAE measures of 
performance and significant business processes in place at NDCPH. This thesis 1s also 
intended to acquaint the reader with an understanding of the basic elements of the GPRA, 
the HSAE and the Balanced Scorecard concept, and the similarities of each. 
Recommendations were provided for improving performance measurement and strategic 


management of Naval Dental Centers through the Balanced Scorecard. 


It ıs assumed that the reader has a basıc knowledge of commercial and 
government service organizational structure as well as business, management and 
accounting terminology. The reader should be aware that the following terms, framework 
and model, and measure and metric will be used interchangeably. 

F. RESEARCH METHODOLOGY 

The research methodology starts with a comprehensive review of literature 
related to the Balanced Scorecard, GPRA and HSAE, and a review of the performance 
measurement data and significant business processes in place at NDCPH during the 
HSAE and a twelve-month period following. An analysis of the performance measures 
and data and their relationship to the HSAE, Balanced Scorecard and GPRA criteria will 
be performed throughout the thesis as applicable. This analysis should lead to 
development of a generic Balanced Scorecard model for NDCPH and end with evaluating 
applicability of such a model for Naval Dental Centers as a management tool. 

The literature research included (1) books, (2) professional journals and 
periodicals, (3) DOD publications, (4) Government and private Internet sources, 

(5) archival data from NDCPH, (6) NDCPH's HSAE submission booklet, and 
(7) interviews with relevant NDCPH staff, conducted via electronic mail. 
G. ORGANIZATION OF STUDY 

This thesis contains six chapters. Chapter I provides the background of the study 
and introduces the thesis subject. Also included were brief comments on the purpose of 
the study, prımary and secondary research questions that the study was framed around, 
scope of the study, and research methodology. Chapter II will expound on pertinent 


information discovered in the literature review intending to add to the readers' knowledge 
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and understanding of the concepts introduced in the study such as the Balanced 
Scorecard, GPRA and the HSAE (Malcolm Baldridge National Award) and will discuss 
NDCPH's HSAE submission booklet. Chapter I will present the methodology used in 
the study. Chapter IV will be a presentation and analysis of relevant data and information 
collected. Lastly, Chapter V will conclude the thesis with findings and recommendations 


resulting from the study. 


Il. LITERATURE REVIEW 

This chapter, through a discussion of relevant literature, will provide a general 
understanding of the Balanced Scorecard concept, the Government Performance Results 
Act of 1993 (GPRA), the Hawaii State Award of Excellence (HSAE) and will conclude 
with a brief overview of NDCPH's HSAE Application. 

A. THE BALANCED SCORECARD CONCEPT 

l1. Origins 

Measuring performance in service organizations has always been difficult 
due the lack of tangible outputs or products. The dramatic increase of service-based 
organizations within the U.S. economy exacerbated this problem. [Ref. 5] 

Robert S. Kaplan and David P. Norton addressed this need of improving 
performance measuring in service organizations in 1992 through developing the balanced 
scorecard concept [Ref. 6]. The concept grew out of a yearlong research project that 
involved several companies with a history of demonstrating useful innovations in 
performance measurement. Kaplan and Norton expanded on their original concept 
through subsequent articles [Ref. 7,8] and a book titled The Balanced Scorecard: 
Translating Strategy into Action [Ref. 2]. 

Since it's inception, Kaplan and Norton's concept has attracted significant 
attention of many organizations in the private and public sectors. An example of its wide 
interest was noted in a recent "World Wide Web"- based search of the term "balanced 
scorecard”, which resulted in over 900,000 "hits" (listings). Additionally, a 1998 survey 
of "Fortune 1000" organizations indicated that sixty percent of them have had experience 


with the balanced scorecard [Ref. 9]. Websites devoted to assisting Federal agencies with 
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using the balanced scorecard are also now available [Ref. 10,11]. The balanced scorecard 


concept will now be explained. 


2. Features 


Kaplan and Norton's balanced scorecard provides managers with an alternative 
method of measuring overall organizational performance that not only utilizes financial 
data, which measures historical performance, but also adds three "nonfinancial" areas of 
measure. These three broad nonfinancial areas involve customer service, internal 
processes, and innovation and improvement. The balanced scorecard "balances" the 
traditional measures with three nonfinancial areas that may give a better picture of future 
performance. [Ref. 1,2] 


a. The Four Components of the Balanced Scorecard [Ref.2] 


(1) Financial Measures. These measures are important indicators of how 
well an organization's current strategies are performing. They are not necessarily very 
good measures of future (strategic) events because they are measures of past events. 
Examples include operating income or sales growth. 

(2) Customer Service Measures. These measures involve evaluating the 
effectiveness of an organization's strategies in attracting, satisfying and retaining 
customers. Examples of measures include customer satisfaction surveys or market share 
changes. 

(3) Internal Business Processes. These are measures of internal processes 
that are critical (strategic) to the success of the organization. Examples of measures 


include the amount of time it takes to satisfy a customer's service needs from time of 


identification of a need to satisfaction of the need, or the amount of time a customer must 
wait in line for service. 

(4) Learning and Growth Measures. These are measures of the capability 
of an organization's employees to carry the organization successfully into the future. 
Examples of measures include employee satisfaction or employee's current level of skills 


versus skills that will be required to meet customers’ needs. 


3: Strategic Management Application 


Following up their initial work, Kaplan and Norton emphasized the use of the 
balanced scorecard as a Strategic Management System [Ref. 8]. Kaplan and Norton found 
that the process of creating a balanced scorecard forces senior management of an 
organization to determine the critical objectives and performance measures to be 
included. This “strategic” information should provide guidance for the organization’s 
future. Furthermore they detailed four helpful strategic management processes, which 
should be introduced during the development of the organization’s balanced scorecard. 

a. Four Helpful Strategic Management Processes. [Ref.8] 

(1) Translating the Vision. This is the clarification of the 
organization's vision and strategy. An organization's vision can be defined as its ultimate 
objective. From this vision an all-encompassing vision statement is written that should 
explain the reason for the organization's existence. How an organization reaches this 
vision is its strategy. Senior management, while developing the balanced scorecard, must 


agree upon the vision and strategy. The vision will provide a clear picture of the 


organization's purpose and the strategy will contain useful guidance for achievement of 
defined objectives throughout all levels of the organization. 

(2) Communicating and Linking. This involves organization-wide 
dissemination of the balanced scorecard's strategic objectives and measures. All members 
of the organization should have access to this information. Feedback from all levels 
should also be encouraged to allow for increased buy-in, future strategies and inspire 
local efforts that support the vision. 

(3) Business Planning. This process allows organizations to coordinate 
their business plans with their financial plans. Organizations undergoing business process 
changes ın multiple areas can be difficult for senior managers to keep on track towards 
common strategic goals. The balanced scorecard objectives can help through prioritizing 
strategic goals and matching resources to the most strategic projects. 

(4) Feedback and Learning. The balanced scorecard is employed as a 
tool to periodically analyze the current strategy by looking at short term results ın all four 
of the performance measure areas and providing feedback for future changes. Such 
"learning organizations" have the advantage of not being static and constantly looking for 


ways to improve. 


4. Problems With the Balanced Scorecard 
a. Arthur M. Scheiderman's Findings 
Although the interest and use of the balanced scorecard ın general 
or as strategic management tools have significantly increased, the concept is not without 


its problems. Prior to Norton and Kaplan’s introduction of a balanced scorecard, Arthur 
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M. Schneiderman developed and used a similar concept, the corporate scorecard, in 1987 
while Vice-President of Quality and Productivity at Analog Devices, Inc. Over the years 

he has witnessed the use and misuse of the balance scorecard in many organizations and 
has offered the following six reasons for failure of it as a strategic management tool [Ref. 
WAR 


1. Nonfinancial measures are incorrectly identified as the primary drivers 
of future stakeholder satisfaction. 


2. The metrics are poorly designed. 


3. Improvement goals are negotiated rather than based on stakeholder 
requirements, fundamental process limits, and improvement process capabilities. 


4. No deployment system that breaks high level goals down to the sub 
-process level where actual improvement activities reside. 


5. A state of the art improvement system is not used. 


6. There is not and can not be a quantitative linkage between 
nonfinancial and expected financial results. 


5. Unit Manager Evaluation Tool 


Kaplan and Norton have asserted that individual business units of an organization 
should develop and use unique balance scorecards and that the managers of each of these 
units should be evaluated based on these unique scorecards [Ref. 2]. But a recent study 
[Ref. 9] showed, given a choice between unique and common performance measures 
from which to judge business unit managers' performance, evaluators usually select only 
the common measures to base their evaluations on. This would seem to decrease the 


value of individual business unit balance scorecards because unit managers would not 
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have a reason to include unique performance measures in their future unit balanced 


scorecards. 


6. Balanced Scorecard and Healthcare Organizations 


Is the balanced scorecard applicable to healthcare organizations such as the Naval 
Dental Center in Pearl Harbor? As a service organization it would seem so. The Dental 
Center, like most healthcare organizations, historically has used performance measures 
similar to the structure of balance scorecard because of the nature of the service provided. 
Customers (patients) drive all actions and must be satisfied with their service (treatment 
and outcome) or their health will be endangered. Patient care and business processes must 
be designed to meet the needs of the patients with an eye on financial considerations. 
Lastly, most staff personnel require regular training and education to maintain 
professional standards and licenses. 

Other evidence of its applicability follows. The balance scorecard has been 
advocated for use in healthcare organizations as both a "framework for driving 
performance" [Ref. 13] and/or "a tool for energizing and focusing management" [Ref.14]. 
An example of a healthcare organization that is currently using balanced scorecard is the 
Calgary Regional Health Authority (CRHA)[Ref. 15]. It is a system of three hospitals and 
two medical centers, employs over 11,500 staff and includes 2,000 inpatient beds. 

CRHA's management team adapted Kaplan and Norton's balanced scorecard ideas 
to their organization as seen in their Business Plan 2000-2003. The four key macro-areas 
included are Patients and Clients, Innovative Delivery System, People and Partners, and 


Financial Accountability. Table 2.1 displays CRHA's four key perspectives: 
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Looks at the organızatıon through the eyes and 


Patients and Clients experience of the people we serve. 


Looks at the quality and effectiveness of service delivery 
and internal processes. 


Innovative Delivery System 


Looks at what the organization must learn and change to 
People and Partners be successful in the future from the perspective of our 

people and partners. 

Looks at the organization from a financial and 


Financial Accountability accountability perspective. 





Table 2.1 CHRA Scorecard Key Perspectives. After Ref. [15] 


CRHA's balanced scorecard is shown in the following figure. 
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Figure 2.1. CRHA's Business Plan 2000-2003 Balanced Scorecard. From Ref. [15] 
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The Naval Dental Center Pearl Harbor, significantly smaller than the CRHA but 
similar as a healthcare service organization, should be able to develop a balanced 
scorecard that is similar to the one used by CRHA. 

B. GOVERNMENT PERFORMANCE RESULTS ACT 

In spring 1993, President Clinton announced that Vice-President Gore would head 
the undertaking of a six-month National Performance Review of all government agencies 
[Ref. 16]. The goal of this initiative was to create a government that "works better, costs 
less, and gets results Americans care about." Congress, which had been working on a 
similar efforts aimed at improving government, put forth a bill that became Public Law 
103-62 in August 1993 entitled the Government Performance and Results Act of 1993 
(GPRA)[{Ref. 3]. These two high-level events were indicative of the government’s serious 
interest in restoring the public’s faith in its abilities. The important features of GPRA that 


are relevant to this thesis will be summarized next. 


l. Section 2 


This section of the act states that Federal agencies: will be systematically held 
accountable for achieving program results; set program goals, measure program 
performance against those goals, and report publicly on their progress; promote a new 
focus on results, service quality, and customer satisfaction; and improve service delivery. 
It requires Federal mangers to plan for meeting program objectives by giving them 


feedback on program results and service quality. 


Ze Section 3 


This section of the act states that Federal agencies need to develop a five-year 
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strategic plan with: a comprehensive mission statement; general goals and objectives; 
description of how these goals and objectives are to be reached (including resources 
required; and identification of key factors external to the agency and beyond its control 
that could significantly affect its achievement of its goals. 

In summary the act requires Federal agencies to improve their performance 
through developing strategic (long-term) plans, clarify their mission, set goals and 
objectives, and be able to show that they are progressing towards their goals. These goals 
must focus on results, service quality, and customer satisfaction. Although the act was 
designed for Federal agencies, subordinate components of the agencies will have to 
follow similar requirements. In essence The Naval Dental Center Pearl Harbor will be 
affected by it. 

G, HAWAI STATE AWARD OF EXCELLENCE 

1. Establishment 

The Hawaii Chamber of Commerce established the Hawaii State Award of 
Excellence (HSAE) to recognize organizations in Hawaii that have demonstrated superior 
management and performance [Ref. 17]. The award is one of forty-two programs based 
on the Malcolm Baldridge National Quality Award [Ref. 18] among all fifty states. 
Organizations interested in recognition and outside review of their management and 
performance, voluntarily perform a documented self-assessment, and submit it along with 
an application to HSAE for review. If the submission is rated favorably, a team of HSAE 
evaluators will undertake a site visit for a more in-depth evaluation and validation of the 
self-assessment document. If the document is validated and a certain threshold of points 


reached the organization can be presented with the HSAE. The HSAE uses the same 
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criteria for evaluation as is used for the Malcolm Baldridge National Quality Award, 


which will be now examined. 


= Origin 

Public Law 100-17, known as the Malcolm Baldridge National Quality 
Improvement Act of 1987, resulted in the Malcolm Baldridge National Quality Award. 
The purpose of this law and award was to stimulate private industry to improve its 
productivity and output quality by improving its management, otherwise the United 
States might fall behind its global marketplace competitors.[Ref. 4] 

Some examples of past winners of the Malcolm Baldndge National Quality 


Award include Xerox, Cadillac, Motorola, and Federal Express. 


3. Award Criteria 


The criterion for winning the performance excellence award was established by 
the National Institute for Standards and Technology (NIST) [Ref. 19]. The following is a 
list from NIST of the seven main areas assessed with a brief overview of specific items 
that are examined: 


Leadership: The company's leadership system, values, expectations, and public 
responsibilities. 


Strategic Planning: The effectiveness of strategic and business planning and deployment 
of plans, with a strong focus on customer and operational performance requirements. 


Customer and Market Focus: How the company determines customer and market 
requirements and expectations, enhances relationships with customers, and determines 
their satisfaction. 


Information and Analysis: The effectiveness of information collection and analysis to 
support customer-driven performance excellence and marketplace success. 
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Human Resource Focus: The success of efforts to realize full potential of the work force 
to create a high performance organization. 


Process Management: The effectiveness of systems and processes for assuring the quality 
of products and services. 


Business Results: Performance results, trends, comparison to competitors in key business 
areas-customer satisfaction, financial and marketplace, human resources, suppliers and 
partners, and operations. 
D. NDCPH HSAE APPLICATION WITH SELF-ASSESSMENT DOCUMENT 
The Naval Dental Center Pearl Harbor's quest for outside review of its 
organizational management and performance and consideration for the Hawaii State 
Award of Excellence began with the completion and filing of an application and self- 
assessment document. The document, 56 pages in length and complete with charts, tables 
and graphs, explicitly demonstrated how well NDCPH met each of the criteria as an 
organization. This self-assessment document is the focus of this thesis and will be 
thoroughly reviewed in the following chapters. 
E. SUMMARY 
This chapter provided a general literature review of the key ideas that will 
be addressed in this thesis. The origin of the balanced scorecard concept and its major 
components were discussed and the concept was shown to be adaptable to healthcare 
organizations. The importance of the government's efforts to improve its services, like 
those provided by the Naval Dental Center Pearl Harbor, was reviewed through the 
GPRA. Government efforts, both state and national, to improve private industry and not- 
for-profit service providers was shown through the HSAE and Malcolm Baldridge 
National Quality Improvement Act review. Finally, a brief description of the Naval 


Dental Center Pearl Harbor's HSAE application was presented. 
17 


THIS PAGE LEFT INTENTIONALLY BLANK 


HI. METHODOLOGY 

This thesis is intended to show how a generic Balanced Scorecard model, 
applicable to all Navy Dental Centers, could be developed from objectives and 
performance measures in use at NDCPH, recipient of the 1998 Hawaii State Award of 
Excellence. The methodology to accomplish this will be explained. Please note that 
metrics and measures are to be considered synonymous in this thesis. 

Although Kaplan and Norton emphasized that each business unit in a very large 
organization create its own Balanced Scorecard [Ref. 2], for the purposes of this thesis, 
NDCPH will be treated as one business unit because it is a relatively small organization, 
(business unit) within a larger organization-the Navy Bureau of Medicine and Surgery 
(BUMED). 

A. LITERATURE SEARCH 

In order to increase the author’s and readers' knowledge and insight on the 

relevant topics, a search was conducted for literature and information about the Balanced 
i 

Scorecard (BSC) concept, the Government Performance Results Act (GPRA), and the 

Hawaii State Award of Excellence (HSAE). This search included books, texts, articles, 

the Internet and e-mail. 

Robert S. Kaplan and David P. Norton, credited with developing the Balanced 
Scorecard, provided the majority of the information on it through a series of articles in 
the Harvard Business Review and their book The Balanced Scorecard: Translating 
Strategy into Action. Information from other articles supporting or criticizing the BSC 
were found to be helpful. Another interesting source of information came from numerous 


Websites on the Internet, including government focused, and dedicated to the BSC idea. 
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GPRA, a public law, was available from the Congressional Record. Other related 
information was available form articles and the Internet sites promoting it such as Vice- 
President Gore's National Performance Review. 

Information regarding the HSAE came from e-mails with the Award 
Administrator, Internet sites, and the NDCPH HSAE self-assessment document. In 
addition, since the HSAE is based on the Malcolm Baldridge National Quality Award 
(also a public law), reviewing the Congressional Record on it, and the 1998 award criteria 
helped significantly in explaining it. The importance of the HSAE is that it can be 
considered a significant validation of the strategic management, quality, and performance 
of NDCPH and its performance measures. 

B. NDCPH PERFORMANCE MEASURES 

The HSAE self-assessment document provided the majority of information on 
the performance measures. The post-HSAE performance measures and data came from 
NDCPH archival data, e-mails with NDCPH staff, and from BUMED sources including 
the Navy Manual of the Medical Department and Navy Dentistry Strategic Plan 2000. 

NDCPH’s performance measures are the core of this thesis as they will be 
presented, described and evaluated for potential inclusion in the model BSC for Navy 
Dental Centers. Determination of potential inclusion of performance metrics in a model 
BSC was based on how the specific metrics contributed to answering Kaplan and 
Norton's question for each of the four perspectives, as presented in their initial article on 
BSC. Also any supporting metric data was analyzed as to its significance and usefulness 


as a performance measure by comparing it with examples from Kaplan and Norton’s 
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literature and from empirical deduction. The author’s personal knowledge gained while 
serving as NDCPH comptroller added to this analysis. 

Since a change 1n leadership occurred after the HSAE application was submitted, 
this thesis also intended to examine changes in objectives and performance measures, 
influenced by the new leadership, and also consider any changes for inclusion in the BSC 
model. 

E: BSC MODEL 

Once the metrics to be included in the model BSC were identified, a model BSC 
for Navy Dental Centers was constructed. Each of the four perspectives was given 
objectives or targets and names of the corresponding measures. 

D. SIMILARITIES BETWEEN BSC, GPRA, AND HSAE 

Through the literature research and review, discussion of the each of these, 
similarities, namely the need for identifying an organization's purpose and output, 
developing a strategic plan, focusing on customers and quality, establishing goals, and 
determining ways to measure performance, within the thesis and construction of the 
model BSC, it is expected that a implicit understanding of the similarities of all three of 
these will be apparent. A summary of the similarities will be presented ın the final 
chapter. 

E. SUMMARY 

This chapter revealed the methodology to be followed as this thesis moves 

towards the development of a model BSC for all Navy Dental Centers. The methodology 


includes a literature search, a discussion of the NDCPH performance measures and the 
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identification of BSC metrics, building the BSC model, and finally how the similarity 


between BSC, GPRA and HSAE will be examined. 
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IV. ANALYSIS OF PERFORMANCE MEASURES AT NDCPH 

BSC's, as previously discussed, are strategic management tools that monitor 
performance of an organization through financial and nonfinancial measures. Per Kaplan 
and Norton, the ideal time to determine these measures is during strategy forming 
activities and the four perspectives from the BSC can provide guidance. The goal of the 
measures should be to constantly steer the organization towards its vision and mission. 
NDCPH had done a process similar to this when 1t developed its vision and mission. 

The primary purpose of this thesis 1s to determine if a generic BSC for Naval 
Dental activities could be developed. Such a tool could assist in making strategic 
management decisions. In order to develop the generic BSC, a source of performance 
measures was needed. NDCPH performance measures will be presented and reviewed as 
a potential source of performance measures in this thesis for two reasons. First, NDCPH 
was recognized for achieving and sustaining the highest level of performance of an 
organization in Hawaii by being awarded the 1998 HSAE. Second, the author was 
familiar with NDCPH's operations and management having served as the command 
comptroller from June 1996 to May 1999. 

The specific performance measures to be included in the generic BSC will be 
derived from the HSAE Self-Assessment document and for the period following the 
HSAE, (Post-HSAE), from archived data. Also metrics instituted or proposed by higher 
authority (BUMED, DoD, Secretary of the Navy) will be considered. At the end of the 
description and analysis of each performance measure, a determination of its 


appropriateness for inclusion in the generic BSC will be made. 
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A. HSAE SELF-ASSESSMENT DOCUMENT 

This fifty-six-page document, constructed by two senior ranking Navy 
dentists on staff at NDCPH, was part of the application process submitted for 
consideration in the 1998 HSAE. The information and metric data were collected and 
adjusted as needed to fit into the self-assessment framework of the HSAE document. The 
framework for the HSAE document was based on the criteria used in the Malcolm 
Baldridge National Award. It is important to note that some of the data was being 
collected prior to the HSAE and regularly reported to Navy Dentistry Corporate 
Management (Headquarters) or other higher authority. Other data was established for 
local management reasons and included in the HSAE. 

Mentioned previously, the HSAE Self Assessment Document, followed the 
format of the Malcolm Baldridge Award, having been based upon it. The format required 
an Organization Overview and seven sections. The sections addressed the following 
organizational areas: 1.0 Leadership, 2.0 Strategic Planning, 3.0 Customer and Market 
Focus, 4.0 Information and Analysis, 5.0 Human Resource Development and 
Management, 6.0 Process Management, and lastly, 7.0 Business Results. 

This thesis focused on two areas of the HSAE document, the Organization 

Overview and Section 7.0 Business Results. A copy of these two areas from the HSAE 
document is contained in the appendix. Because these two areas provided the majority of 
the information required, only these two areas were used. However, amplifying or 
clarifying information was taken from the other sections as needed. Each of the two areas 


is discussed below. 
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1. HSAE Organizational Overview 


In the Organization Overview, the command's Mission, Vision, Key Success 
Factors (KSF's) were presented. The Mission, common to all naval dental centers, was 
derived from corporate headquarters, called the Bureau of Medicine and Surgery 
(BUMED). The command's senior management board, the Executive Steering Committee 
(ESC), determined the command Vision and identified the KSF's as the path to achieving 
it. The ESC is comprised of the CO, XO, Command Master Chief (senior enlisted 
member of command), Branch Clinic directors, Comptroller and Director of 
Administration. The NDCPH Vision, Mission and KSF's are discussed next. 

a. Vision 
To be the Dental Clinic people want to come to. NDCPH strives to be the 
healthcare organization where patients want to have their treatment done, 
the facility where staff members want to come to work, and the command 
where dental corps personnel actively seek to be stationed. 
The bold letters and underlining were done to stress the importance 
of being "the place" for all three of these groups of people. Therefore NDCPH's 
management strategy should be geared towards achieving this vision and measurable 
objectives should be established to reflect this. It is important to note that each dental 
center can have a different vision. 
b. Mission 
NDCPH's mission is "Dental Readiness". A patient is considered dentally 
ready if no dental complication is anticipated within one year. Befittingly 
our motto is "Fit to Bite, Fit to Fight". The concept of readiness is the 
very essence of why we exist. The result is that fighting forces will be 
dentally ready to complete their mission. NDCPH gives priority treatment 


to those individuals that deploy on ships, submarines and aircraft groups. 
However, shore support personnel regularly rotate to deploying units. 
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Consequently, every effort is made to keep their dental readiness high as 
well. 


The mission is simple, keep sailors and marines dentally ready for 
fighting. This is what NDCPH and all Naval Dental Centers should be striving for every 
day. NDCPH must be able to monitor its performance in this area and should have related 
measurable objectives. In fact BUMED requires regular dental readiness performance 
reports from all Naval Dental Centers. 

E KSF's 


Dental Health as ıt ıs reflected ın quality and quantity of treatment 
provided and dental readiness of personnel. 


Our People as they develop both professionally and personally. 


Customer Satisfaction by improving access to care and making every 
effort to "WOW" our customers at every available opportunity. 


Facilities by modernizing our facility and equipment thus enabling 
NDCPH to provide the highest quality services to our customers. 


These KSF's were the guidance provided by the ESC to the command to 
make the Vision a reality. The personnel of the command would need regular measurable 
feedback to determine if they were heading in the nght direction. Again performance 


measures would be expected to provide direction. 


Z: HSAE Section 7.0 Business Results 


The Business Results section contained charts and graphs of data from the twenty- 
six metrics used in the HSAE. These metrics were selected because they met the 
requirements for performance monitoring in five specific areas as outlined in the HSAE. 


These areas were: 7.1 Customer Satisfaction Results, 7.2 Financial and Marketplace 
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Results, 7.3 Human Resource Results, 7.4 Supplier and Partner Results, and 7.5 
Company Specific Results. 

Descriptions of each metric were taken from the HSAE document [Ref. 5], the 
Navy Manual of the Medical Department [Ref. 22], and the author's personal knowledge 
as former comptroller at NDCPH. Samples of several of the graphs that were included in 
the HSAE are shown. Metrics that were still in use before and after the HSAE will be 
incorporated in the graphs (as available data allowed) for comparison. The time frame of 
the HSAE data ranged from 1988 (in some cases) to April 1998. Unless relevant, only 
data from 1995 to 1998 was included. 

The HSAE and Post-HSAE data will be identified in the descriptions. Any 
metrics identified as not part of the HSAE, can be attributed to the change in leadership 
or a change from the corporate headquarters and would have begun after September 
1998. These "new" metrics and data will be discussed later. The metrics will be presented 
in the groups and order as was in the HSAE document. 

a. Section 7.1 Customer Satisfaction Results 

The metrics included were designed to determine if the command was 
meeting the needs of patients or taking steps to meet these needs. 

(1) Number of Prophies (Cleanings). This metric, part of the 

Mandatory-reporting metrics, measured the command's efforts at achieving the objective 
of providing more of what the customer wanted. Patients indicated in past surveys that 
they desired more dental prophies, which are teeth cleanings. This prophylactic treatment 
(hence the term "prophies) 1s usually scheduled once a year. NDCPH responded by 


increasing availability of this service. 


27 


The metric is the average number of prophies per month in a fiscal 
year (October through the following September) and is shown in Figure 4.1. The 
difference between the monthly average for FY98 and FY99 is about 65, which if 
multiplied by 12 months equals 780 more treatments in FY99. This is an increase of 
about 6.4%. There was no benchmark or information to indicate the overall significance 
of this measure. A better measure of prophy treatments would be the percent of 
population that had received at least one cleaning in the current FY. The author will 


include an improved metric in a "Customer Service" related perspective. 
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DER 4.1 Average Number of Prophies per Month. After Ref. [5] 

(2) Patient Perception of Services. This NDCPH established 
metric was monitored through data from regular patient satisfaction surveys and indicated 
how the command's objective of improving dental services was working. The average 
annual percent of positive responses by surveyed patients to care received was tracked. 
Corresponding Post-HSAE data was not available. Figure 4.2 shows a lower percent of 


positive responses from FY91-93 due to a change in summary reporting. The percent of 
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positive responses from FY95-97 were high and stable. A new satisfaction survey was 
being developed in FY98 and results were not available. A patient satisfaction survey will 


have to be included in a "Customer Service" related perspective of the model BSC. 
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Figure 4.2 Patient Satisfaction With Services After Ref. [5] 


(3) Patient's Perception of Access to Care. Another NDCPH 





established metric, this annual survey of patients was conducted to reveal how these 
customers feel about their ability to receive care in a timely manner, which was NDCPH's 
objective. The percent of positive responses to questions about access to care was 
tracked. A similar metric became mandatory in FY99 and will be discussed ın the Post- 
HSAE section. It is expected that this data will be collected as part of the new Navy 
Dentistry Patient Satisfaction Survey. 

(4) Number of Exams at the Deckplate. The objective was to 
increase the number of exams away from the fixed dental clinics. This NDCPH 
established metric was a quarterly report of the number of exams done away from the 


fixed dental facilities. Alternate dental exam locations included mobile dental vans which 
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can be set up on the docks and piers in close proximity to ships and submarines or remote 
land sites, temporary dental offices near active duty personnel work-sites, and finally on 
deployed ships or submarines by dental personnel placed on the vessels temporarily. This 
measure shows how dentistry services can be brought to the working personnel 
(deckplates) versus personnel going to the fixed dental facility. 

The biggest advantage to the line commanders is that personnel 
will miss less work and commands wil! not have to spend resources on getting personnel 
to and from the dental facility. The disadvantage to the dental clinic is the expense of 
dental vans and personnel being pulled from the fixed clinic to provide this service. 

Figure 4.3 displays the number of personnel examined outside of 
the fixed dental facility from FY97Q3 to FY98Q2. A cyclical pattern is seen as the 
number of deckplate exams decreases from FY97Q3 to FY98Q1 and then increases in 
FY98Q2. This ıs due to late summer provider "turnover" gaps, holiday periods and 
normal ship deployments. This is a measure of improving access (Customer related) and 
a new process to decrease lost work time so it could be included in an "Internal Business 


Process" related or "Customer Service" related perspective. 
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Figure 4.3 Exams at the "Deckplate". After Ref. [5] 
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(5) Percentage of Employees Receiving Customer Service 


Training. An NDCPH established quarterly report showed the command's efforts at the 
objective of ensuring that employees (actıve-duty as well as cıvılıan) received formal 
training in customer service with the intent to improve customer and staff interactions. 
Data was collected during the fourth quarter of FY97 and the first 

quarter of FY98. The percent of employees receiving this training significantly rose from 
28% to 77% thus demonstrating the level of importance the command placed on this 
objective. All staff personnel should be trained in Customer Service. This metric could be 
included in a "Customer Service" related perspective as it demonstrates efforts to 
improve how patients "see" the Dental Center, or in a "Learning and Growth" related 
perspective. 

b. Section 7.2 Financial and Marketplace Results 

In the world of private business, organizations monitor financial and 
marketplace performance through traditional measures, such as revenue, net income, 
return on investment, stock price to earnings ratio, etc., which are all related to the 
amount of goods or services provided to customers. The HSAE criteria required that 
NDCPH include financial and marketplace results. NDCPH, like all Government entities, 
could not measure its output in the same way as private firms. NDCPH (and all DOD 
dental centers) did have a primary output and it was called dental readiness. For the sake 
of the HSAE, NDCPH indicated that measurements of dental readiness would be 
interpreted as marketplace results (getting needy patients in the door and improving 
overall readiness) and production would be interpreted as a vehicle to compete with other 


naval dental facilities for personnel and resources (production changes indicating a need). 
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(1) Operational Dental Readiness (ODR)-Percentage of Fleet 
Units Leaving Pearl Harbor at 100% Operational Dental Readiness (ODR). ODR is the 


measure of personnel (percent) in either Dental Class 1 or 2 from a particular unit all the 
way up to the entire Navy. These personnel are considered operationally dentally ready. 
The importance of this measurement 1s that these personnel should not require emergency 
dental care within the upcoming year [Ref. 22] or more importantly while deployed. 
Therefore, since most vessels do not have advanced dental 
treatment capability, the units’ missions should have less chance of disruption from dental 
problems. NDCPH's objective was to ensure that all vessels deployed from Pearl Harbor 
with only dental Class 1 or 2 personnel onboard. This NDCPH established metric utilized 
mandatory reporting data. It was an annual percentage of deploying units with personnel 
at 100% ODR. Figure 4.4 below shows NDCPH's focused efforts on this objective in 
FY98 when 100% ODR was reached by all deploying units. This metric, will be included 
in a "Financial Measure” (output) related perspective. It has been benchmarked at 100%, 


set by the Head of DoD (Health Affairs), a major stakeholder for Navy Dentistry. 
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. Figure 4.4 Fleet Operational Dental Readiness. After Ref [5] 
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(2) ODR-Average Readiness/Month. The objective was to strive 
for all active duty sailors and Marines to be Class one or two (dentally ready to deploy). 
This is similar to the above metric but it is an average percent of all active duty Navy and 
Marine personnel that fall under the responsibility of NDCPH. Two years of HSAE and 
two years Post-HSAE data (CY98-99) are presented in Figure 4.5. A steady increase in 
this measure can be seen in the first three years of data. Corrections to the data collection 
and reporting in CY 98 resulted in a slight decrease. The percentage increased again in 
CY99. In 1998, NDCPH set a stretch goal of 95% ODR up from 85% a figure arbitrarily 
set by the Secretary of the Navy in the same year. This data was extracted from 
mandatory reporting data. This measure could be combined with the above metric to form 
one metric. It could then be included in a "Financial Measures" related perspective as a 


measure of output. It has a benchmark set by DoD(HA) of 95%. 
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Figure 4.5 ODR Average Per Month. After Ref. [5] 


(3) Percent of Personnel in Class 1 Status (DHI). Also known as 





the Dental Health Index (DHD), the objective was to continuously strive to increase this 


index. These patients are considered to be in the ideal state of dental health because no 
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treatment is required or anticipated during the next twelve months [Ref. 22]. Figure 4.6 
shows a steady increase in this metric over a nine-month period towards the Department 
of the Navy’s (DON) goal of 47%, set in FY2000. 

HSAE data was estimated from a graph but still should be 
considered reliable. Post-HSAE data 1s from December 98 and March 99. This data was 
extracted from mandatory reporting data. This metric will be included in a "Financial 
Measures" related perspective because of the DON goal and as it is the only measure of 
the percent of “Dentally Healthy Sailors and Marines’, which is Navy Dentistry’s Vision 


as stated ın ıts Strategic Plan 2000. 
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Figure 4.6 Percent of Class 1 Personnel. After Ref. [5] 

(4) Percentage of Appointments to Class 3 Dental Patients. The 
objective was to target this neediest class of personnel. It was a monthly percentage of all 
appointments filled by Class 3 patients, who have dental conditions that have potential to 
require emergency care within twelve months [Ref. 22], and therefore are a risk to their 


unit?s mission. This data was extracted from mandatory reporting data. This metric could 
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be included in either an "Internal Business Process"related perspective because it relates 
to efforts to get these patients into the Dental System, or in a "Customer Service" related 
perspective as 1t meets patients' needs. 

(5) Recall Compliance. This NDCPH established metric was a 
monthly percent of personnel who had not responded to notices from NDCPH regarding 
the need to make a dental appointment. The objective was to decrease this percent. 
NDCPH used this data to focus on certain commands or personnel. Via a succession of 
contacts, from the lowest level of command and rising as far as needed, the personnel 
were persuaded to report to the clinic. A graph was not presented due to incomplete data. 

(6) Production (Number of Procedures). NDCPH set up this 
metric to track the total number of procedures performed by NDCPH in a year. The 
objective being measured was to ensure NDCPH was as productive as possible but this 
could not be determined from the data. Combining the patient population or number of 
dentists onboard with this measure would have made more sense as a measure of 
production or output. Figure 4.7 shows a significant downward trend in the number of 
procedures. Changes in population served and reporting methods contributed to the drop. 
This data was extracted from mandatory reporting data and was estimated from a graph. 
An improved metric, developed by Navy Dentistry Headquarters, will be included in a 


"Financial Measures" related perspective. Figure 4.7 is shown on the next page. 
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Figure 4.7 Production (Number of Procedures). After Ref. [5] 

(7) Number of Failures. This monthly NDCPH established metric 
was the total number of appointments not kept and therefore indicated a measure of 
opportunities lost to treat patients, improve readiness and man-hours spent trying to 
contact and reschedule these people. The objective was to reduce this number. Efforts to 
do so included providing appointment cards and contacting a command representative the 
day before the appointment. 

E: 7.3 Human Resources Results 
NDCPH is committed to promoting its employees' professional and 
personal development. These metrics should provide evidence of such. 

(1) Internal Customer (Staff) Satisfaction. The objective was to 
determine the command’s working climate. This mandatory annual survey (printed), 
called the Command Assessment Survey, was given to all employees. Individuals 
responded to a series of questions using a sliding scale scoring system. Results were to be 


kept confidential. The annual average of four key areas of the survey, Advancement 
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Opportunities, Discipline, Grievances, and Fraternization, was included in the HSAE. A 
similar staff satisfaction survey is to be started by Navy Dentistry in 2001. This survey 
will be included in a "Learning and Growth" related perspective.. 

(2) Advancement Test Score Improvement. This NDCPH 
established metric was to track enlisted advancement test scores. Eligible enlisted 
personnel participate in Navy-wide biannual advancement tests up to the Chief Petty 
Officer (E-7) level. This metric could be used in conjunction with the next metric to 
determine effectiveness of command programs to help enlisted staff improve their scores. 

Post-HSAE data began in March 1998. A review of the data in 
Figure 4.8, shows that high test scoring individuals in the E-4 test population, who 
boosted the average scores, would expect to boost the E-5 test scores in one year and the 
E-6 test scores in three years due to minimum time in grade requirements. Advancement 
examination test scores are strongly dependent on test-takers personal desires to succeed 


therefore this metric will not included in any of the perspectives. 
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Figure 4.8 Advancement Test Score Improvement. After Ref. [5] 
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(3) Hours Volunteered for Lunch and Learn Program. The 
objective was to ensure enlisted personnel were given assistance in advancement 
opportunities. This NDCPH established metric tracked the quarterly total number of 
hours volunteered by senior enlisted and officers to assist in lunchtime enlisted 
advancement exam preparation. Figure 4.9 displays the data and can be contrasted to 
Figure 4.8 Advancement Test Score Improvement to determine if there was a relationship 
between the number of volunteer “Lunch and Learn” hours and test improvement. A 
better test of the “Lunch and Learn” program would have been to compare test score 
averages before the program and afterwards. The spike in FY98Q2 was probably 
influenced by the outgoing Commanding Officer’s desire to see this program work and 


the HSAE. Post-HSAE data began in the third quarter (Q3) of Fiscal Year 1998. 


Class Hours Volunteered Per Quarter 





FY97Q2 FY97Q3 FY98Q2 


Figure 4.9 Volunteer Hours for Lunch and Learn. After Ref. [5] 
(4) Number of Personal Awards Presented. The objective 
was to track the number and type of awards presented by the command to officers, 
enlisted and civilian staff. This was done to ensure that awards were being fairly 


distributed among the groups. Personal awards could be medals, letters of commendation, 
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letters of appreciation or monetary/time-off (civilian) awards. Awards were based on 
merit and no awards were mandatory. The total number and type of Personal Awards 
presented to staff enlisted, officer or civilian members was compiled and reported to 
higher authority. This metric could be included in a "Learning and Growth" related 
perspective. This data was extracted from mandatory reporting data. 

(5) Number of Officer Continuing Education Hours. Although not 
required, NDCPH strove to provide each dental officer with one command-funded trip 
for continuing education (CE) purposes per year. The objective was to ensure personnel 
were given opportunities for professional improvement or obtaining required CE hours to 
maintain licensure. An annual total of officer CE hours was collected. 

Figure 4.10 shows these numbers from FY95 to FY99. The number 
of ours depends on several factors including number of dentists, availability of 
discretionary funds and command priorities. The decrease in FY98 and 99 reflect a 
tightening on available funds not fewer dentists. This measure was not significantly 
useful because it does not measure whether or not all officers were able to obtain the 
necessary CE hours, and rank does not always indicate the level of CE hours required 
annually. Post-HSAE data began in 1998. A related metric proposed by the author was 
included in the "Learning and Growth" related perspective. Figure 4.10 is shown on the 


next page. 
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Figure 4.10 Number of Officer CE Hours. After Ref. [5] 


(6) Number of Physical Readiness Test Failures. Military staff 





members are required to participate in a biannual fitness test to demonstrate acceptable 
levels of endurance, cardiovascular health and flexibility. The command's objective was 
to track efforts to reduce the number of failures. This data was extracted from mandatory 
reporting data. 

d. 7.4 Supplier and Partner Results 

Results of how well NDCPH interacts with partners and suppliers 
are monitored through the following metrics. 

(1) Dental-Medical Recycling Partnership. The Dental and 

Medical clinics joined together to collect and turn in recyclable material thus reducing the 
number of trips necessary to deliver recyclable materials (the objective). This NDCPH 
established metric tracked the total pounds of recyclable materials per quarter that were 


turned in for recycling. 
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(2) Supply Order Receipt Time. A NDCPH established metric 
that provided a quarterly report of the average number of days that were required to 
process individual routine supply orders by the Fıscal and Supply Department. The 
timing of the metric began when the Supply Department received the requisition and 
ended when the ordering department received the material. The objective was to reduce 
the average supply order-to-receipt time in days, reduce the amount of inventory 
required, and ensure a steady flow of supplies. 

Figure 4.11 illustrates that this objective was successfully being 
carried out. These results were accomplished through an increased use of the Government 
Purchase Card, changes in federal regulations, and changes in processes in the Fiscal and 


Supply departments. There was no Post-HSAE data as this objective was considered met. 
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Figure 4.11 Supply-Order-Receipt Time. After Ref. [5] 


(3) Government Purchase (Credit) Card Use. The objective was to 


maximize the use of this purchasing vehicle. An annual total number of supply and 


service purchases using the Government Purchase Card was collected. Maximal use of 


4] 


thıs card was encouraged because of advantages such as greatly reduced supply order 
receipt time and increased purchase source flexibility. In FY1998, usage became 
mandatory and this metric became obsolete. 

e. 7.5 Company Specific Results 

NDCPH created the following metrics to measure performance ın 
other areas considered important enough to the command and the HSAE award criteria to 
warrant monitoring. 

(1) Man-hours Volunteered by Command Employees. This metric 
was the annual total number of man-hours volunteered towards helping the command or 
community. NDCPH combined volunteering and the "Spirit of Aloha" by stressing 
volunteerism (its objective) in the local community. Figure 4.12 shows the amount of 
hours volunteered. Both command and community volunteerism by command employees 
showed major increases as volunteerism was greatly encouraged by command 


management. This metric could be included in a "Learning and Growth" related metnic. 
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Figure 4.12 Command Volunteer Hours. After Ref. [5] 
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(2) Percent of Employees Volunteering. Similar to the previous 


metric, this metric broadly monitored employee volunteerism. It is an annual percent of 
employees who volunteered time and assistance to the community or command. 

(3) Plant Maintenance/Upgrade. An annual report of the total 
amount of command funds spent on plant maintenance and upgrades. Although not an 
exact measure of efforts to provide employees and customers with desired quality, clean 
and safe facilities (its objective), it could be considered a reflection of a continuing 
commitment to do so. A better measure of actual facility upgrade would not include the 
routine maintenance costs. Figure 4.13 shows significant variation in FY96. Special 
project funding for specific upgrade requirements was made available by BUMED in 
FY95 and FY97. FY96 was not necessarily a down year but reflected normal funding for 
plant maintenance and upgrades. This metric has potential but does not fit Kaplan and 


Norton's BSC perspectives. Post-HSAE data was not available. 
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Figure 4.13 Plant Maintenance/Upgrade Costs. After Ref. [5] 
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(4) Status of Plant Projects (% Completion). This metric was 


designed to ensure that facility improvement efforts did not stall and thereby reduce 
employee enthusiasm in the workplace (objective). Each project was divided into a series 
of steps that were assigned a percent of completion. Included in the steps were 
verification of the project by the Operating Management Officer and CO as a legitimate 
need, priontization among other needs, getting an estimated cost, setting aside funds and 
ending with completion. A total percent of steps from all projects was then tabulated and 
reported. Like the previous metric, this metric has potential but does not fit Kaplan and 
Norton's BSC perspectives. 

(5) Are Internal Customer Needs Being Met? The Supply and 
Dental Equipment Repair departments conducted a one-time, joint internal customer 
satisfaction survey in 1998 for the purposes of the HSAE to determine if they were 
meeting the internal needs of their customers (objective). These two support teams were 
selected because they have the most impact of all support teams on patient treatment. 

| Figure 4.14 illustrates that 54% of customers gave an 

"outstanding" rating and 98% felt that the Supply and Repair departments were at least 
"good" at meeting their needs. Further surveys, although potentially useful, were not 
formally conducted as this survey was specifically performed for the HSAE. Surveys 
from every department could be a way to gather innovative ideas or redirect efforts 
therefore this metric could be included in a "Learning and Growth" related perspective. 


Figure 4.14 1s shown on the next page. 
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Figure 4.14 Supply & Repair Departments Customer Survey. After Ref. [5] 
B. POST-HSAE PERIOD | 
In August 1998, the leadership of NDCPH changed. This occurred after 
the submission ofthe 1998 HSAE application. Any changes in the command Vision, 
Mission, KSF’s or performance measures would have occurred under the new leadership 
and has the potential to show strategic changes and influences due to the new leadership. 
Performance metrics differing from the HSAE measures will also be examined for 


inclusion in a generic BSC. 


1. Organizational Overview 


The command Mission, Vision and Key Success Factors were not changed 
significantly from the 1998 HSAE overview. Minor language changes were made in the 
descriptions of two KSF's to allow them to fit on one line. In the Customer Satisfaction 
description, the phrase "at every available opportunity" was deleted. The new description 
is — “by improving access to care and making every effort to "WOW" our customers’”’. In 


the Facilities KSF description, the phrase "the highest" was deleted. The new description 
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is - by modernizing our facility and equipment thus enabling NDCPH to provide quality 


services to our customers. [Ref. 5] 


2. Performance Metrics 
a. Mandatory Metrics 
BUMED’s Navy Dentistry office developed these metrics and began 
requiring regular reports form Naval dental activities in FY99. The descriptions are taken 
from Navy Dentistry Strategic Plan 2000. Examples of available data will be presented. 
(1) Class Three Longevity. This metric measures the ability of the 
dental treatment system to find ways to reduce the number of Class 3 patients, the most 
"dentally unprepared" personnel. The measure is the percentage of patients per month 
who have been identified as Class 3, ninety days or more ago, from the total number of 
patients. The significance of this measurement is that these personnel have dental 
conditions that if not treated are expected to result in dental emergencies within twelve 
months [Ref. 22] and therefore the personnel are potentially nondeployable. The 
objective was to lower this number each month and thus increase total force readiness. 
Figure 4.15 shows data collected over the first six months of the 
start of the metric. As expected the highest percent of Class 3 patients was in the first 
month of this new metric. As attention and resources are shifted to reducing this number, 
it decreased to a low of 49.78% in the third month. It increased slightly and continued to 
do so for the next three months which could indicate a closer scrutiny of all patients for 
Class 3 indicators or that a change in processes is needed. More time and data would be 


required to make any determinations on the effectiveness of efforts to reduce this number. 
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Also a benchmark would need to be established to gauge efforts. Since this measure will 
indicate the commands efforts to highly prioritize this class of patients it could be 


included in a "Customer Service" related perspective. 
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Figure 4.15 Percentage of Class 3 Patients Greater Than 90 Days. After Ref. [5] 


(2) Personnel Training. The objective is to ensure personnel are 





receiving training to maintain licensures or acquire new dentally related skills, 
techniques, and knowledge that can improve the overall level of dental services provided. 
The measure, accumulated and reported quarterly, measures the amount of full-time 
equivalents (FTE) spent by officer, or enlisted personnel in training. One FTE is equal to 
the annual, reportable number of hours an active duty member is considered on the job or 
more simply, one FTE equals one body. The training consists of non-readiness training 
(CEU's, technical training, etc.) and any readiness training required to allow personnel to 
deploy as needed. 

Figure 4.16 shows the results of the first two quarters in FY99. 
Most training occurs in the second and third quarters of a FY and this explains the 


difference in the quarters on the graph. The problem with this metric is that it is difficult 
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to discern what the values on the graph actually mean, are they good or bad? In addition, 
how is the value to the command of the training determined, and are training 
opportunities fairly offered to all staff. The author has proposed a similar metric 


regarding training and could include it in a "Learning and Growth" related perspective. 
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Figure 4.16 Total FTE's Assigned to Training by Quarter. After Ref. [5] 

(3) Clinical Production. The objective is to ensure the command 
is as clinically productive as possible. As explained by BUMED, when utilized, this 
monthly metric will be the ratio of dental weighted values (DWV) produced or performed 
per month to the number of FTE's of dental providers available. A DWV is a specific 
weighted value, as determined by the American Dental Association, assigned to each 
dental procedure. The DWV directly varies in proportion to the type and complexity ofa 
procedure. Also the higher the DWV ofa procedure, the more clinical trme (FTEs) 
should be spent in performing the procedure. But if providers are working inefficiently, 
fewer DWV’s per FTE’s will be produced. This metric will be included in the Financial 
Perspective as it relates directly to productivity. The providers of care (generators of 


DWVs) can be dentists, dental hygienists or dental assistants (military or civilian). 
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This metric was not fully instituted so only the total monthly FTEs 
spent in clinical care by the three categories of providers during the first half of FY99 is 
presented in Figure 4.17. The number of dentist and dental assistant FTE’s vary in direct 
proportion as the assistants directly support the dentists. The number of hygienist FTE’s 
remains relatively stable because they are either Government employees or under 
contract and are expected to spend the majority of their time treating patients. All three 
categories of providers’ FTE numbers are strongly influenced by patient failure rates and 
patient availability (e.g. holiday periods). This metric, if used as intended, could be 


included in a "Financial Measures" (output) related perspective. 
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Figure 4.17 Number of FTE's Assigned to Clinical Treatment. After Ref. [5] 

(4) Clinical Utilization. This metric is a companion to the previous 
metric. It is a ratio (percentage) of the time, in FTE's, dentists (military and contract) 
were involved in clinical treatment (same number as the denominator in the previous 
metric) per their total reportable time. Reportable time includes the time at work that is 
not spent in training, travel or other nonclinical activities. This measure shows how well 


dentists were able to utilize their reportable work time in actual patient treatment. The 
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objective, set by BUMED in FY99 is 70% for military dentists and 90% for contract 
dentists. 

Figure 4.18 indicates that NDCPH was consistently below the 
target set by BUMED during the first six months of FY99. More time and data will be 
needed to adequately judge NDCPH’s performance. Since there is an established 
benchmark and it is a measure of effective use of clinical time, this metric could be 


included in a "Internal Business Processes" related perspective as it is an efficiency ratio. 
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Figure 4.18 Percentage of Dentist FTE's Used Clinically. After Ref. [5] 

(5) Access to Care. Patients (customers) cite lack of access to 
dental care when it was most convenient for them as a major source of dissatisfaction. 
BUMED established a goal of ensuring that every patient was given a choice of at least 
three different appointment dates/times within the next twenty-one days. Each specific 
department or branch clinic had to report, quarterly, whether or not it could meet this 
requirement. A graph was not practical to present. The new Patient Satisfaction Survey 


should provide relevant data for a "Customer Service" related perspective. 
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b. NDCPH Established Metrics 

The following metrics were established after the HSAE and 
change in command leadership and should reflect new strategic influences. They are in 
no particular order of priority or importance. 

(1) Command Income (Revenue). The metric is similar to 
measuring productivity or output. The objective as in any corporation is to maximize 
revenue and hopefully income. Military dental facilities often treat non-DOD patients 
such as NATO forces and United States Coast Guard members. Reimbursement rates 
(dollar values) per procedure have been established to allow these facilities to be 
reimbursed for treatment provided. This is similar to revenue not income in the private 
sector. 

The CO of NDCPH expanded upon this concept of placing 
monetary values on procedures to approximate how much revenue the clinic was 
theoretically producing. The total value of procedures was called command or corporate 
income, although the term revenue should have been used. Clinics, departments and even 
providers could get a tangible estimate of the value of their work and productivity. 
Patients could also be told of the value of the services (benefit) provided to them. 

This metric data could be presented by month, quarter or FY and 
upper and lower control limits could be added to help in analyzing the data. Figure 4.19 
displays the command income per FY. An increase in command revenue and therefore 
productivity, appears to have been eee by this metric. Incentives such as increased 
liberty (time off) were instituted to further increase competition among departments. 


FY00 revenue was on pace to break the $10,000,00 level. 
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The significance of this metric is that it instills a sense of monetary 
value of services provided by the providers and can even be used to show recipients of 
care a good approximation of their dental benefits available in military service. This 
metric, renamed Command Revenue, could be included in a "Financial Measures" related 


perspective as it ties productivity to financial value. 
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Figure 4.19 Command (Corporate) Income by FY. After Ref. [5] 
(2) Per Capita Income (Revenue). This metric, begun in January 

2000, is determined by dividing the total revenue generated through dental services 
provided by the total clinical FTE's reported for the same time period. The objective is to 
maximize the per capita income or income generated by the available staff. Figure 4.20 
shows considerable variance that could be due to cyclical events such as staff turnover, 
deployment of ships, learning curves of new staff, etc. Also it should be noted that a 
relatively small number of FTE’s utilized to perform high value procedures (root canals, 
oral surgery) will skew the data upwards and in contrast, lower value, high FTE 
procedures such as routine dental examinations will skew it downward. Due to this 


variability, Per Capita Income will not be considered as a BSC metric. 
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Figure 4.20 Income per Clinical FTE . After Ref. [5] 

(3) One-Stop Shopping. This new metric was started to track the 
percent of prophies done on all patients with exam appointments. Senior management set 
a strategic objective to schedule prophy treatments in conjunction with all scheduled 
dental exams. The intent was to reduce multiple trips to the dental clinic and lost work 
time. Most patients due for annual exams either required or desired a “cleaning”. Figure 
4.21 shows that NDCPH was able to increase “‘one-stop shopping” by 17% from FY99 to 
FY00. This metric could be included in a "Internal Business Processes" related 
perspective as it tracks improving treatment efficiency, or in a "Customer Service" related 


perspective as it is a measured response to their needs. Figure 4.211s shown on the next 


page. 
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Figure 4.21 Percentage of Prophies Done on all Exam Patients . After Ref. [5] 

(4) Comparison of Provider Average Productivity. This is a 
measure of provider productivity (DWV/FTE) comparing output measures resulting from 
providers utilizing a new concept called "Expanded Function operations", and output 
from the same number of providers utilizing the normal operating processes. To review, 
DWVs are weighted values assigned by the American Dental Association to dental 
procedures. Complicated procedures are weighted more heavily (thus more costly to the 
payer) and simpler procedures less heavily. Expanded Function was an initiative begun 
by senior management to determine if provider productivity could be increased by having 
the provider work multiple treatment chairs (rooms), the standard in private practice, 
versus the normal military, one-chair (room), one-provider concept. As the provider 
completes treatment on a patient in one room, he or she moves directly to the adjacent 
room that has a patient seated and prepared. Meanwhile the previous room is cleaned and 
filled with another patient. Idle time waiting for an open chair and room cleaning should 
be dramatically reduced. Coordination of support personnel is critical in ensuring the 


success of this concept. 
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Due to space constraints, only a limited number of providers were 
able to participate in this pilot project. Figure 4.21 shows a dramatic increase in 
productivity of the providers in the expanded function category. Such data could be used 
to request funds to modify the clinic to allow more providers to participate. If successful, 
it could also result in a reduction of providers locally and eventually Navy-wide. This 
metric could be included in an "Internal Business Processes" related perspective because 


it measures improvement in treatment efficiency. 
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Figure 4.22 Comparison: Provider Average Productivity. After Ref. [5] 
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ía: CHAPTER SUMMARY 

This chapter presented the objectives and metrics in use by NDCPH 
during and after the HSAE period. The sources of information were the HSAE Self- 
Assessment Document [Ref. 5], NDCPH archives from the Post-HSAE time period and 
Navy Dentistry strategic plans. Pertinent information about each metric was provided and 
a determination as to which, if any, of the four BSC perspectives the objectives and 
metrics should be included in. This information will be utilized in the next chapter to 


build a model BSC for NDCPH and all Navy Dental activities. 
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D. SUMMARY OF PERFORMANCE MEASURES 


1. HSAE Document-Section 7.0 Business Results 


7.1 Customer Satisfaction: 


Number of Prophies 

Patient Perception of Services 

Patient's Perception of Access to Care 

Number of Exams at the Deckplate 

Percentage of Employees Receiving Customer Service Training 


7.2 Financial and Marketplace Results: 


Operational Dental Readiness (ODR) Percentage of Fleet Units 
Leaving Pearl Harbor at 100% ODR 

ODR Average Readiness/Month 

Percent of Personnel in Class I Status (DHI) 

Percentage of Appointments to Class 3 Patients 

Production (Number of Procedures) 

Number of Failures 


7.3 Human Resources Results: 


Internal Customer Satisfaction 

Advancement Test Score Improvement 

Hours Volunteered for Lunch and Learn 
Number of Personal Awards Presented 

Number of Officer Continuing Education Hours 
Number of Physical Readiness Test Failures 


7.4 Supplier and Partner Results: 


Dental-Medical Recycling Partnership 
Supply Order Receipt Time 
Government Purchase Card Use 


7.5 Company Specific Results: 


Man-hours Volunteered by Command Employees 
Percent of Employees Volunteering 

Plant Maintenance/Upgrade 

Status of Plant Projects (% Completion) 

Internal Customers Needs Survey 
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Post HSAE Period 


Mandatory Metrics 


Class Three Longevity 
Personnel Training 
Clinical Production 
Clinical Utilizatıon 
Access to Care 


NDCPH Established Metrics 


Command Income (Revenue) and related measures 
Per Capıta Income (Revenue) 

One-Stop Shopping 

Comparison of Provider Average Productivity 
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V. BUILDING A PROPOSED FRAMEWORK 

As noted in the Literary Review, the primary benefit of using the BSC is that it 
allows managers a simplified way to regularly evaluate their organization's short term 
and long-term strategies towards the organization's vision by reviewing data captured 
through four perspectives. Kaplan and Norton suggested four perspectives; (1) financial, 
considered a short-term strategy metric (based on historical output); and three long-term 
strategy forecasters based on operational activities, (2 )customer satisfaction, (3) internal 
processes, and (4) the organization's innovation and improvement efforts. 

It is this author's opinion that such a strategic management tool, using a balanced 
mixture of a short-term strategic measure, and three longer-term operative measures 
could be useful to governmental service organizations like NDCPH as well as profit- 
oriented firms, the BSC's original intended target. Therefore the author, in answering the 
primary research question of this thesis, "How can a Balanced Scorecard model of 
performance measurement be applied to NDCPH?" will construct a proposed framework 
for a BSC for NDCPH. The secondary questions will be answered as the framework 1s 
built or following its completion. 

The BSC must be based on the organization's links between 1ts Vision and 
Mission and strategies to achieve them. NDCPH's Vision and Mission are linked to 1ts 
strategies through its Key Success Factors (KSFs) that were defined as the path to 
NDCPH's Vision in the HSAE document. The Vision can be summarized into "NDCPH 
being the Navy Dental Clinic of choice for both patients and employees (military and 
civilian)". The Mission can be summarized into "Dental Readiness" which means getting 


Sailors and Marines in Dental Class 1 or 2 so they are worldwide deployable. 
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Fulfilling these KSFs will ensure that the Mission is being accomplished and 
NDCPH is doing the nght things to approach its Vision. The KSFs, developed by 
NDCPH's strategic management team, the Executive Steering Committee, were (and still 
are): 

Dental Health as it is reflected in quality and quantity of treatment provided and dental 
readiness of personnel. 

Our People as they develop both professionally and personally. 

Customer Satisfaction by improving access to care and making every effort to "WOW" 
our customers at every available opportunity. 

Facilities by modernizing our facility and equipment thus enabling NDCPH to provide 
the highest quality services to our customers. 

These four KSFs have similarities to Kaplan and Norton's four perspectives in the 
following ways. "Dental Health" an output related measure based on historical data, 
provides a short-term look at how the organization is doing. The three other measures, 
more related to operational functions, can provide long-term indications of operational 
success. They are "Our People" (the causes of innovation and recipients of learning), 
"Customer Satisfaction" (the major drivers of and most affected by organizational 
activities), and "Facilities" (affects future services provided). Because of these 
similarities, and the significance of the KSFs as strategic indicators, the KSFs will be 
considered as the goals to be achieved (perspectives) in the BSC proposed framework. 
All data examples were derived from Chapter IV. 

A. NDCPH BSC FRAMEWORK 
The perspectives will now be matched up with measures directly drawn from, or 


generated by ideas from, NDCPH's HSAE and post-HSAE time periods as presented in 


the previous chapter. The criteria for selection involved the author drawing on personal 
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experiences while performing comptroller duties at NDCPH as well as knowledge and 
information acquired while researching the BSC. Each of the measures selected support 
the perspective (KSF) that it falls under and therefore supports NDCPH's Vision and 
Mission. The resulting framework, with data examples from Chapter IV, is a proposed 


NDCPH BSC framework based on this thesis. 


E Dental Health 
-as it is reflected in quality and quantity of treatment provided and dental 
readiness of personnel. 


Goal Measures 
Dentally healthy and dentally ready -DHI (% in Class 1 status of all 
Sailors and Marines. patient population) 
-ODR (% in Class 1 or Class 2 status 
of all patient population) 
-Clinical Productivity (DWV/FTE) 
-Clinical Utilization (Clinical 


FTE/Reportable FTE) 

-Class 3 Longevity (time from 
identification of a Class 3 patient till 
appointment scheduled) 

-Command Revenue 





The selected measures are all indicators of NDCPH efforts to raise the level of 
dental health and readiness of its patients. For example, the "DHI" was increased from 
18.10% in FY97 to almost 35% in FY99. In addition Navy Dentistry has set a benchmark 
of 47% for this metric. "ODR" of deployed fleet units (a subcategory of this metric), 
measured in percent of units deployed at 100%, rose from 82% in FY97 to 100% in 
FY98. 100% should considered the benchmark for this metric. 

"Class 3 Longevity", a measure of how well NDCPH is doing to get its most 


needy patients in for treatment, dropped from 66.01% in October 1999 to 54.42% 
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ın Aprıl 2000. A benchmark for thıs metric should be considerably lower. 

"Clinical Production" and "Utilization" will be more useful when applied 
correctly and with more data collection. "Clinical Utilization" does have a Navy Dentistry 
benchmark of 70%. 

"Command Revenue" shows an approximation of the monetary value of the 
services provided to military personnel based on fees of services performed by private 
dentists. It is also is a monetary measure of output. NDCPH produced $7,232,307 worth 
of services in FY98. In FY99 it produced $8,555,914 and was on pace to surpass 
$10,000,000 in FY00. This metric also can be used to stimulate a competitive spirit 
within a dental center and could be used to provide patients an estimate of the significant 
value of their dental benefits. 

2: Our People 

-as they develop both professionally and personally. 

Goal Measures 

Be the Navy Dental Clinic of choice for -Staff satisfaction survey 
Military and Civilian staff. -Personnel training measures 


-Number and distribution of Personal 
Awards 


-Number of innovative ideas piloted 
or implemented by staff 

-Staff command and community 
volunteer opportunities 





A "Staff satisfaction survey " should give the best overall assessment of this goal 
and it is expected that the Navy Dentistry staff satisfaction survey , when initiated, will 
provide the necessary data. The staff satisfaction data in the HSAE was based on the 


annual Navy-wide mandatory Command Assessment Survey. This data or similar survey 
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data would have to somehow be summarized into a score for the entire command in order 
to work in a BSC. The other measures, " Personnel training measures", "Number and 
distribution of Personal Awards", " Number of innovative ideas piloted or implemented 
by staff’, and "Staff command and community volunteer opportunities" 

could support or refute the survey results. For example if an officer states that not 
enough resources (money or travel time or both) are not provided, a metric displaying 
measures of these could be offered to dispute or support his claim. 

The "Number of innovative ideas piloted or implemented by staff "could be a 
measure of how the command responds to such ideas, and if positive would be an 
attractive feature of this command. 

An example of "Volunteer opportunities”, often a source of personal growth and 
satisfaction, was seen in the measure Number of Command Volunteer hours. Volunteer 
hours rose by 1,000 from CY 96 to CY 97. These measures would be difficult to 
benchmark except possibly for "Personnel training" which contains some specific 
requirements. 

3. Customer Satisfaction 


-by improving access to care and making every effort to "WOW" our customers at 
every available opportunity. 


Goal Measures 
"Wow" customers with service and access. | -Customer satisfaction survey 
-Exams at the "deckplate" 
-Percent of appointments to Class 3 


patients 
-"One-Stop" shopping 
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An explanation of how these measures support the goal is as follows. A 
"Customer satisfaction survey" would be the primary measure of service, access, and 
quality as perceived by patients. An example of this showed that from FY95 to FY97, 
94% or more of the patients surveyed gave positive responses to NDCPH's services. 

"Exams at the deckplate" and "One-Stop shopping" are measures of programs 
initiated to increase access or reduce the number of visits required, issues that are high on 
patient satisfaction indices. For example the percentage of "One-Stop shopping" visits to 
NDCPH increased by 17% from FY99 to FYOO. 

The "Percent of appointments to Class 3 patients" is an excellent indicator 
of how the dental center 1s managing this most crucial group of patients. The most recent 
data in the HSAE document showed that this percentage increased from 7% in September 
1997 to 27% in February 1998. 


4. Facilities 


-by modernizing our facility and equipment thus enabling NDCPH to provide the 
highest quality services to our customers. 


Goal Measures 
Modernize the facility and equipment -Value of plant/maintenance upgrades 
to provide the highest quality services. | -Status of plant projects (% completed) 
-Internal satisfaction survey of supply 
and dental equipment repair services 















How the measures support the goal in this perspective will now be addressed. 
Although not specific enough, the measure "Value of plant/maintenance upgrades" would 
indicate a command strategic (financial) commitment to modernization. An example 
from NDCPH data showed that NDCPH increased its expenditures in this area from 


$316,718 in FY 96 to $555,047 in FY97. However, this metric needs to separate out the 
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fixed annual maintenance costs from new work (modernization). As most of the money 
for modernization is not included in the command's annual allotment, this measure really 
indicates how well a command is at identifying its needs and convincing BUMED to 
provide the extra funding. 

The measure "Status of projects completed", is designed to show what percentage 
of completion each project is. This measure was to indicate to the staff that work was 
indeed moving along and not stagnating as often perceived. 

The last measure "Internal satisfaction survey of the supply and dental repair 
departments”, a one-time survey during the HSAE, indicated how staff members felt 
about services provided by the supply department, which orders and receives new 
equipment, and the dental equipment repair department, which not only repairs 
equipment but also can alert users of the need to replace equipment and provide guidance 
on the what equipment to order. The results of the survey indicated that 98% of the staff 
rated the departments’ services at least "good". Of this 98%, 54% rated it as outstanding 
and 32% as excellent. 

B. CHAPTER SUMMARY 

This chapter reviewed Kaplan and Norton's original concept of the BSC. This 
review included looking at the importance of the organization's vision and mission and 
their relationship to a BSC, and the use of one financial or output related perspective 
(short-term indicator) balanced against three operations based perspectives (long term 
indicators) that dealt with customers, internal processes, and innovation and learning (of 


staff). 
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The proposed framework was then completed by matching up selected 
performance measures from Chapter IV (or developed by the author) with the appropriate 
perspective (KSF). This resulting framework development, seen in Figure 5.1, answered 
the primary research question of "How can a Balanced Scorecard model of performance 


measurement be applied to NDCPH?" 
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Figure 5.1 Author's Proposed BSC Framework for NDCPH 
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VI. FINDINGS AND RECOMMENDATIONS 

This concluding chapter will address the primary and secondary research 
questions, discuss potential problems with the BSC, and provide recommendations for 
further implementation and research in this area. 
A. PRIMARY RESEARCH QUESTION 

The primary research question "How can a Balanced Scorecard model of 
performance measurement be applied to NDCPH" was answered in the preceding 
chapter. The chapter presented the "how" during the development of the Proposed BSC 
Framework (model) for NDCPH. It is not difficult to construct such a framework for 
NDCPH because much of the data on mission, vision, KSFs, and performance measures 
was readily available. Below are additional questions that were addressed by the research. 
B. SECONDARY RESEARCH QUESTIONS 


Question 1: How can this model be applied to other Naval Dental Center's as a 
tool for strategic management? 


All Naval Dental Centers base their organizational vision and mission on those of 
higher authority (Navy Dentistry Headquarters). There are also several common 
mandatory performance measures required by Headquarters. NDCPH's proposed model 
BSC incorporated these commonalities, along with some locally generated performance 
measures of outstanding innovations that also could be applicable to other Naval Dental 
Centers. If the other Naval Dental Centers are already capturing performance data similar 
to NDCPH's, and most should be because of the common mandatory reporting 
requirements to Headquarters, then it may be relatively easy to adopt this BSC 


framework to their organizations. They may have to add or replace performance 
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measures more suitable to the individual clinics. If the organizations do not have readily 
available performance data then they would be advised to review the list of references for 
assistance. 

Before any Government organization decides to develop a BSC and specific 
performance measures it should be noted that an article found on the National Partnership 
for Reinventing Government website, entitled Balancing Measures: Best Practices in 
Performance Management [Ref. 23], pointed out that Government organizations should 
use established performance objectives whenever possible in building a BSC. This could 
speed up the process and decrease the amount of resources (funds and personnel) 
required. 


Question 2: Would this BSC provide evidence of complicity of a Government 
organization to the GPRA? 


A BSC could provide some evidence of complicity to GPRA requirements in that 
elements of BSC and GPRA are very similar. Both require strategic (long-term) planning, 
identification mission or purpose, focusing on customers, and setting up ways to evaluate 
the organization's operations. Performance measures are the key requirements to both 
BSC and GPRA. Today, many federal government organizations are considering BSC as 
a means of satisfying GPRA requirements. 

Question 3: Who are the customers and stakeholders of performance at NDCPH? 

The stakeholders of performance at NDCPH include the unit commanders who 
are relying on NDCPH to get their personnel dentally ready and maintain this status. This 
will help to avoid loss of personnel and interruption of the mission due to dental 


emergencies. The next stakeholders are Navy Dentistry who must continue to 
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demonstrate to higher authority that Navy Dentistry provides a critical service that could 
not be done by anyone else as effectively and efficiently. Finally, the American people 
rely on a healthy and ready Navy to defend United States interests at home and abroad. 


Question 4: What performance measures were in place when NDCPH won the 
Hawaii State Award of Excellence (HSAE) and afterward? 


The performance measures in place during the HSAE and afterwards are 
summarized at the end of Chapter IV. These are rather common across Naval Dentistry or 
relatively easy to implement. 


Question 5: What was the criteria for the HSAE and is there a relationship to the 
Balanced Scorecard? 


The criteria for the HSAE, based on the Malcolm Baldridge National Award 
criteria, which consisted of an organization self-assessing its performance in seven 
important areas which were leadership, strategic planning, customer and market focus, 
information and analysis, human resource development and management, suppliers and 
partnering, and business results. The relationship to the BSC is that both involve strategic 
management, customer focus, human resource development and business results (output). 
The HSAE may be broader in its focus because it applies to profit-onented organizations, 
but the program is flexible enough to fit a government services organization such as 
NDCPH. 

Questions 6 and 7: The last two secondary questions "What continuous 
improvement efforts followed the award and why?" and "What effect did new leadership 
have on NDCPH's managerial strategy and performance measures?” will be answered 
simultaneously. 


With the arrival of the new Commanding Officer, strategies were enacted to 


primarily improve on the existing effectiveness and efficiency in the following ways. A 
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metric to measure the monetary value of services provided was started. This metric could 
tell the command how valuable all its services were, how much each department or 
provider had contributed to the overall total, and could tell the patient how valuable his or 
her treatment was. Productivity as measured by this metric rose significantly and 
continues to rise, because of the awareness of the importance of the value added by the 
command to the Navy. 

A pilot project of having one dentist provide services in two rooms, called 
“expanded functions" was begun. The performance metric for this innovation has 
prompted a dramatic rise in productivity versus the traditional one-room, one dentist, and 
one patient concept. This is an excellent example of "process reengineering" that 
improves overall performance without adding new resources. 

Lastly, an initiative was begun to implement and track the effectiveness of the 
"One-Stop Shopping" idea. All patients receiving an examination would also be co- 
scheduled for a cleaning (prophy). This reduces multiple trips to the dental center as well 
as lost work-time. The related metric has shown that the percentage of these scheduled 
appointment types has been increasing. This not only saves service times but also 
improves the use of patient time for dental related activity. 

E: POTENTIAL PROBLEMS WITH THE BSC 

In Chapter II, Scheiderman's findings revealed six reasons for failure of BSC as a 
strategic management tool [Ref. 12]. Utilizing his ideas, the following are examples of 
potential problems with a BSC used by a Naval Dental Center. 


Metrics must be designed to indicate performance towards supporting a particular 
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perspective (also known as a guiding principle or KSF). This in turn indicates how well 
an organization 1s progressing towards its mission and vision. Metrics that do not indicate 
the significance of the data, such as number of procedures performed or amount of 
money spent on plant maintenance/upgrade are poorly designed. They can be improved 
by incorporating them into a ratio or percentage. Examples could be the number of 
procedures performed per FTE or percent of money spent on modernization out of the 
total spent on plant maintenance/upgrade. Managers must be able to tell if the data 
indicates good or bad performance and/or identify trends. 

Improvement goals should not be negotiated but must be based on stakeholder 
requirements and improvement process limits or capabilities. For example, a goal of 
reaching a certain level of DHI, above a "higher-authority" required level, may be 
negotiated between Naval Dentistry Headquarters and its Naval Dental Centers. The 
operational unit commanders, as stakeholders, may be struggling to reach or maintain 
their ODR requirements, which are not as stringent as DHI. The unit commanders may 
not be able to allow their personnel the extra time off from mission requirements to go to 
the dental center as often as required to participate in this DHI goal. 


D. RECOMMENDATIONS FOR FURTHER STUDY 
l. A follow-up study of a Naval Dental Center's experience using the 


proposed model BSC would be appropriate. Changes in objectives and metrics either 


caused by, or causing, changes in strategies should be carefully noted. 


2. A comprehensive review of current objectives and performance measures 
used by Naval Dental Centers, including the mandated ones, to identify common or 


sıgnificantly different objectives and measures. 
7 


3. Translate the BSC framework to Naval Medical Activities which have 


very similar operating characteristics. 
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ORGANIZATION OVERVIEW 


Naval Dental Center, Pearl Harbor (NDCPH) provides the highest quality dental treatment to military 
personnel in the Pacific theater (area where military operations take place). NDCPH serves Sailors and 
Marines stationed on ships, submarines, air squadrons as well as all shore stationed support personnel. 


NDCPH operates five branch dental clinics, two satellite dental clinics, and one Mobile Dental Unit 
(MDU). The largest branch dental clinic, located in the Command Headquarters building at Pearl Harbor, 
treats the majority of patients and provides specialty dental treatment (oral surgery, endodontics, 
periodontics, etc.) and referral services for the other branch clinics. The next largest branch dental clinic is 
at Naval Air Station, Barbers Point, while smaller branch dental clinics are located at Camp Smith, Ford 
Island, and Wahiawa. Satellite clinics are located at the Branch Medical Clinic in the Naval Shipyard and 
the Pacific Missile Range Facility, Barking Sands (Kauai). One dentist operates the Mobile Dental Unit. 
Approximately 128 command members at the aforementioned locations provide services to more than 
18,000 personnel. 


NDCPH Mission 


NDCPH’s mission is “Dental Readiness.” A patient is considered “dentally ready” if no dental 
complication is anticipated within one year. Befittingly, our motto is “Fit to Bite, Fit to Fight”. The 
concept of readiness is the very essence of why we exist. The result is that fighting forces will be “dentally 
ready” to complete their mission. NDCPH gives priority treatment for those individuals that deploy on 
ships, submarines and aircraft groups. However, shore support personnel regularly rotate to deploying 
units. Consequently, every effort is made to keep their dental readiness high as well. 


NDCPH Vision 


“TO BE THE DENTAL CLINIC PEOPLE WANT TO 

COME TO.” NDCPH strives to be THE health care organization where patients want to have their 
treatment done, THE facility where staff members want to come to work, and THE command where dental 
corps personnel actively seek to be stationed. 


NDCPH Key Success Factors 


To define the path to NDCPH’s Vision, the Executive Steering Committee (ESC) identified the following 
Key Success Factors (KSFs): 


Dental Health as it is reflected in quality and quantity of treatment provided and dental readiness of 
personnel. 

Our People as they develop both professionally and personally. 

Customer Satisfaction by improving access to care and making every effort to “WOW” our customers at 
every available opportunity. 

Facilities by modernizing our facility and equipment thus enabling NDCPH to provide the highest quality 
services to our customers. 


Organizational Relationship 


NDCPH is one of 16 commands that make up the Navy Dental Corps. The Dental Corps provides dental 
services to military personnel throughout the world and is part of the Bureau of Medicine and Surgery 
(BUMED), the organizational center for all medical operations in the United States Navy. The 
organizational diagrams for BUMED and NDCPH are provided in figures 0.1 and 0.2. 

NDCPH Support Departments 
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NDCPH’s support service groups include the following: 


Operating Management Department — ensures safety guidelines and environmental conditions are 
maintained. 

Repair Department - installs and maintains dental equipment. 

Administrative Department - responsible for all matters relating to personnel management, 
correspondence, wage and salary administration, professional credentials and administrative record keeping 
requirements. 


EMPLOYEE DISTRIBUTION 






Supply Department - 


procures “best value” 
supplies and equipment. 
Please refer to the 
Supplier and 
Partnering. 


Assignment Type 
Administrative Suppor [yd en 
[Dental Laboratory Suppor | 0 | a 
[Equipment RepairSuppot | 0 | | 0 SSS 


Figure 0.3 





















section of thıs overview for additional information. 


Fiscal Department - manages all financıal and budgetary matters. 
Management Information Department - management information systems purchase, installation and 
operations; manages and integrates the Local Area Network (LAN). 


Employee Base 
NDCPH has 128 military and civilian employees distributed as described in Figure (0.3). 


Education level: All 25 dental officers have graduated from accredited dental schools and are licensed to 
practice dentistry in at least one state. Nine of the dental officers have completed advanced dental training 
(one or two year programs in comprehensive dentistry or one of the dental specialties). Eleven of the 
dental officers are specialty trained (two-year programs) of which seven are Board Certified and four are 
pursuing Board Certification. 


One enlisted individual has a master’s degree, five have a Bachelor’s Degree, and four have an Associate’s 
Degree. All enlisted personnel have at least graduated from high school. 


All civilian employees have at least graduated from high school. Seven have an Associate’s Degree, nine 
have a Bachelor’s Degree, and one has a Master’s Degree. 


Major Equipment, Facilities and Technologies 


NDCPH’s philosophies meet or exceed the standard of care in dentistry. Using state-of-the-art dental 
equipment, materials, and treatment delivery modalities, NDCPH provides services in most of the adult 
dental specialties including endodontics (root canals), periodontics (gum treatments), oral surgery (tooth 
removal), oral medicine (diagnosis), minor orthodontics, prosthodontics (bridges and dentures) and 
implantology (tooth replacements in the jaw bone). Specific command providers are trained in dental 
materials to ensure the best quality products are being used. Since NDCPH’s facilities were constructed 
over 30 years ago, facility improvement is one of its KSFs for both the short and long term. 
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Customer Requirements 


NDCPH provides state-of-the-art health care services to its customers. Major external customers and key 
outputs are provided in figure 0.4. 


Customers (Patients). NDCPH’s patient population requires quality dental care that is provided in a 
professional, courteous, safe, and tımely manner. 


Unit Commanders desire that their personnel are maintained dentally ready with minimal impact on 
mission. 


The Bureau of Medicine and Surgery (BUMED) tasked dental commands to emphasize readiness and 
dental cleanings. Additionally, the Navy Surgeon General (the head of BUMED) emphasized customer 


service and taking treatment to the deckplates (where the sailors work). 


The Commander Naval Base Pearl Harbor requires all of the above and periodically requests NDCPH’s 
support for multiple volunteer efforts. 


Supplier and Partnering Relationships 


Supplier: NDCPH has an in-house Supply Department that procures “best value” supplies and 
equipment. Supply personnel can purchase items within a prescribed dollar amount ($2500.00). Items 
that exceed that amount are ordered through the Fleet Industrial Supply Center (FISC). 


Principle performance requirements for suppliers include: price; quality of product (meeting very specific 
product specifications); availability of product from a Federal agency contracted for special pricing; 30-day 
delivery for Government credit card purchases; customer service including ease of correcting orders or 
disputed costs. All procurement actions are meticulously recorded so historical data on supplier past 
performance is available. 






Principle External Customers Key Output 
Active Duty Navy Patient Population 
Dental Readiness (Sailors that are fit to fight) 


Higher Authority: 


(1) Bureau of Medicine and Surgery Completed Taskings 
Accountability 
(2) Commander Naval Base Pearl Harbor All of the above plus volunteerism 


Figure 0.4 












Please refer to figure 6.5 for a partial list of major suppliers. 
Partnering. NDCPH shares resources with various military and civilian organizations. Specifically: 


Continuing Education. NDCPH organizes Tn-Service (Amny, Navy, Air Force) conferences, short courses, 
and dental study clubs. NDCPH and Branch Medical Clinic often share training assets and opportunities, 
especially in quality improvement and leadership training. 


Treatment Capability. Tripler Anmy Medical Center (TAMC) provides Oral Surgical support, Orthodontic 
treatment, and Orthognathic surgical services (treatment to correct jaw position). NDCPH provides after- 
hours emergency services and the Oral Surgeon assists with complicated cases at TAMC surgical units. 


Facility Availability. NDCPH provides on-the-job training for dental hygiene students from Northern 
Arizona University. They, in tum, provide increased patient access for dental cleanings. Naval Reserve 
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units use the facility for reserve duty and NDCPH’s patients can access treatment on weekends. NDCPH is 
also used twice a year for board certification testing by both the Hawai'i Dental Board and Registered 
Dental Hygienist Board. 


Assistant Training. Since 1975, NDCPH has operated an American Red Cross Volunteer Training Program. 
The volunteers receive extensive training and certification as a chairside assistant after volunteering for 500 
hours. NDCPH benefits by having more assistants available to the health care providers. 


Competitive Factors 


As a military health care facility, NDCPH has no competition, per se, with respect to its mission. There 
are, however, competitive factors that may impact on our mission. 


Production and Staffing. The amount of dental treatment NDCPH “produces” correlates to the funding and 
personnel that NDCPH will be eligible to receive. As the “production” of dental treatment is compared 
with other Navy dental commands, NDCPH “competes” with them for money and people. 


Wage Disparity. Staying within the confines of Government-imposed wage levels makes it difficult to 
attract and retain quality civilian health care providers. Civilian dentists offer attractively higher wages for 
the same skills. NDCPH strives to be competitive by offering a more professional work environment with 
greater opportunities to expand knowledge, experience and training. 

Access to Patients/Patients’ Access to Care. All dental commands compete for available work time of the 
personnel who maintain the Nation’s security. To compete for that valuable time, NDCPH operates a 
Mobile Dental Unit (MDU), which has the treatment capability of a dental clinic with one notable 
advantage: mobility. It can be moved to the “deckplate” (where patients work), which significantly 
decreases the amount of lost man-hours in transiting to and from the dental clinic. 


Other Factors of Significance to NDCPH 


Regulatory Environment. NDCPH operates in an environment that requires mandatory compliance with 
safety, environmental, contracting, and legal regulations. The Occupational Safety and Health 
Administration (OSHA) and the Navy govern safety standards. Environmental regulations include Federal 
and Hawai'i State laws. Many goods and services must be obtained using contracting procedures mandated 
by DOD and the Navy. Legal requirements are determined by the Uniform Code of Military Justice, and 
Federal and State laws. 


The Future. NDCPH anticipates that future operating budgets and employee staffing will decrease. 
Budgetary modifications possibly will be aligned with civilian operating costs. NDCPH also anticipates 
that military healthcare will progress towards the Tri-Care model, a more encompassing system similar to 
Health Management Organizations. Currently NDCPH does not compete with other local military dental 
organizations, but this may change if all segments of the military healthcare system adopt a “single- 
service” approach. NDCPH’s aim is to implement innovative services to benefit our customers. We will 
continue to seek opportunities to respond to customer input including taking dental treatment to the 
“deckplates”. 


Summary 


NDCPH provides quality dental care to military personnel and its “reason for being” is to ensure the 
nation’s Sailors and Marines are “‘fit to bite, fit to fight!” NDCPH is committed to continual improvement, 
empowerment, and openly embracing the challenges ahead. NDCPH will have a “Change of Command” 
(new Commanding Officer) this summer and we believe the criteria and award process reflected in the 
Hawaı’ı State Award of Excellence offer the most viable approach to “institutionalize” and provide 
continuity to improvement efforts. 
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SECTION 7.0 BUSINESS RESULTS 


NDCPH monitors performance in its Key Success Factors (KSFs) using metrics listed in figure (1.4). The following 
graphs and charts describe NDCPH’s performance in each of the KSFs. 


7.1 Customer Satisfaction Results. The following graphs represent performance in the KSF of Customer Service 
inthe Key Objective of Customer Satisfaction. 


Metric: Number of Prophies (Dental Cleanings) 


Average Number of 
Prophies/Month 


E===) Prophies/Month 





Figure 7.1.1 


Patients indicated by survey that they desired more dental cleanings. Late in 1996 NDCPH initiated two programs 
(“One-Stop Shopping” and a “Phased Cleaning with Dental Technicians and Registered Dental Hygienists”), which 
provided more access to the service. NDCPH also initiated a “Prophy Technician Training Program” which further 
expanded the capabilities in both of the programs. 


Metric: Patient Perception of Services 
Patient Satisfaction Surveys (Fiscal Year 1991 - Fiscal Year 1997) 
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Figure 7.1.2 


Patient Satisfaction Surveys provide NDCPH with the most effective means of objectively assessing how patients 
perceive the services that are provided. Data presented in figure 7.1.2 represents “positive” answers to survey 
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questions. Individual surveys were tabulated for Fiscal Years 1991 — 1993 due to a change in summary report 
information. Fiscal Year 1994 is not presented in the data as only negative responses were recorded and no 


Metric: Patient's Perception of Access to Care 
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individual surveys were available. NDCPH determined that the data would therefore be too inaccurate to be used. 


Figure 7.1.3 


The patient’s perception of access to care (ability to get a treatment appointment) is a major concern for NDCPH. 
Although operating in a “downsizing” philosophy intensifies that concern, NDCPH continued to modify 
processes to limit the impact on patients’ access to care. Despite the fact that NDCPH experienced a significant 
decrease in assigned treatment providers, it managed to keep a strong focus on Customer Service. Data for Fiscal 
Year 1995 includes partially extrapolated information. Information for Fiscal Year 1994 was limited such that the 


Metric: Number of Exams atthe "Deckplate” 
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Figure 7.1.4 data was considered unreliable. 
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The “Deckplate” is where the Sailors work. By modifying the “examination paradigm” and expanding services to 
units using the Mobile Dental Unit, satellite clinics, and temporary exam sites on units, NDCPH was able to provide 
4386 exams at the deckplate in Fiscal Year 1997. This represented savings of approximately 8772 man-hours for 


Percent of Employees Receiving Customer Service Training 
(Cum ulative Percent) 


Percentof Employees Trained 


FY9801 


Fiscal Year and Quarter EEmpioyees Trained 





customers. 

Figure 7.1.5 

NDCPH focuses on customer service and strives to have all employees trained in servicing our customers. With the 
‘stretch goal” of 100% of employees trained in customer service, periodic transfer of military personnel necessitates 
scheduling organized Customer Service Training on a Quarterly basis. Presently the remaining 23% of the 
personnel are scheduled for training at the end of May 1998. A total of four employees received “instructor level” 
training and provide the training locally to NDCPH employees. The instructors are also providing customer service 


training to other commands on Pearl Harbor in May — June 1998. 


7.2 Financial and Marketplace Results 

As a military healthcare organization NDCPH operates in a strictly non-profit setting. However, dental readiness 
may be interpreted as a marketplace gain. Production may be interpreted as a vehicle to compete for personnel and 
available budget for healthcare facilities. 

Our most important function is to deploy (send out) ships and submarines in a “dental ready” status. Prior 





OPERATIONAL DENTAL READINESS (ODR) 
Fleet Units Leaving Peari Harbor at 100% ODR 
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Figure 7.2.1 


to 1997, fleet units deployed with the number of personnel classified as “dental ready” in the range of 78% to 97%. 
NDCPH’s Fleet Liaison Office, with the support of health care providers, committed to “raising the bar”. The last 
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20 ships and submarines to deploy did so with 100% of personnel in a dental ready status. This achievement is 
unprecedented Navy- wide. 









Metric: Operational Dental Readiness (ODR) 
Average Readiness/Month (Calendar Year 1988 - 1997) 
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Figure 7.2.2 

The term “Dental Readiness” refers to a unit’s percent of personnel that are Dental Class 1 (no dental work required) 
and Dental Class 2 (minor dental work that would not be considered a high potential for emergency within 12 
months). The higher readiness is, the more “mission capable” (able to complete their assignment) a unit is. This is 
especially significant when a submarine or ship is deployed (away from home port). Four data points (December 
1994 — September 1995) were derived using interpolation trend analysis due to data not being available. 
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Figure 7.2.3 
Dental Class 1 personnel do not require any dental work to be completed and therefore are considered to be in the 
best possible state of “dental health”. Class 1 data was not available for some data points above. 
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Figure 7.2.4 
Patients that are Dental Class 3 (treatment required may cause a dental emergency within 12 months if not 
completed) present with the most complex treatments and the highest potential for dental emergency. NDCPH 
branch dental clinics give highest priority to dental class 3 patients, often extending their appointment books weeks 
in advance to accommodate them. Incomplete data presented for September 97 due to non-availability. As 
readiness increases a decrease in Dental Class 3 patients would be realized and may impact on the percent of 
appointments to those patients. 
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Metric: Recall Compliance 
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Figure 7.2.5 





97 97 97 97 


97 97 97 97 
Month - Year O Compliance 


97 97 97 97 


One of the greatest obstacles to achieving dental health is not having patients answer recall notices. This metric was 
under reconsideration from June to October 1997. Data collect:on methods improved and a more significant 
“customer group” was identified. Although NDCPH’s performance for “recall compliance” appears poor, the 
process 1s being further assessed for modification and potential for improvement in the future. 
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Metric: Production (Fiscal Year 1989 - Fiscal Year 1997) 
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Figure 7.2.6 
Production (the amount of dental treatment that is provided to patients) trend decreased from Fiscal 1989 to Fiscal 
Year 1997. During this period, from data that is available, NDCPH experienced a decrease in dentists from an 
average high of 34.25 to the Fiscal Year 1997 average of 28.92, the lowest recorded for NDCPH. Despite the 
burden of working with less, production for Fiscal Year 1997 actually increased by approximately 12% when 
compared with Fiscal Year 1996. 


Number of Failed Appointments 
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Figure 7.2.7 

Patients failing to keep treatment appointments wastes provider time (production) and impacts on readiness. The 
holiday period in December commonly is one of the highest failure rates experienced. Some data points in the graph 
above lack sufficient data to be reliable and therefore were not included. 
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7.3 Human Resources Results. 


NDCPH strives to create an enthusiastic work environment in the Spirit of Aloha and provide its employees quality 
training to complete their responsibilities and expand their capabilities. Offering assistance and organizing effective 
roerams, NDCPH promotes its employees professional and personal development. 





Internal Customer Satisfaction 
Results ofCommand Assessment Team Surveys 
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Figure 7.3.1 


Command Assessment Team (CAT) surveys are provided to all employees annually to determine the working 
“climate” at NDCPH. Although a variety of topics are addressed on the surveys, the most significant areas are 
presented in figure 7.3.1. Each of the four areas are assessed using an average score where “5” is the best and “1” is 
the worst. Areas presented are: “Advancement”, the opportunity to increase in rank or position; “Discipline”, that 
NDCPH is fair and equal ın disciplining employees; “Grievances”, that employees understand the grievance 
procedures and have not experienced the necessity for filing one; “Fraternization”, that the guidelines and 
boundaries are firmly set and understood regarding employees fraternizing and that fraternizing is not a problem in 








Metric: Test Score Improvement 
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Figure 7.3.2 NDCPH. 
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Enlisted personnel must take tests to advance until they reach the Chief Petty Officer (senior supervisor) level. Tests 
are given in two cycles per Fiscal Year. Trends reveal positive performance. Average test scores were used in 


figure 7.3.2. 
Hours Volunteered For Lunch & Learn Program 
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Figure 7.3.3 
NDCPH initiated the “Lunch and Learn” program to assist enlisted employees in preparing for the advancement 


tests. Senior enlisted and officers volunteered to give lectures on specific advancement topics during lunch periods, 
ergo the term “Lunch and Learn”. 


Metric: Number of Personal Awards 
Awards for Enlisted/Officer/Civilian Team Members 
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Figure 7.3.4 

One method of compensating employees at NDCPH is by issuing personal awards in the form of Letters of 
Commendation and medal awards. Civilian employees may also qualify for monetary awards. In tabulating the data 
presented in figure 7.3.4, only personal awards warranting medals and letters of recognition from the Commanding 
Officer of NDCPH or from higher authority (e.g. Admiral or General) were considered. Other means of recognition 
at NDCPH, e.g. “Spout Abouts’’, “Team in the Spotlight”, and Department letters of recognition were not included 
in the data. 


87 


Metric: Number of Officer Continuing Education Hours 
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Figure 7.3.5 


Professional continuing education is necessary to keep abreast of the rapid developments in dental technology and 
techniques. Most states also require a minimum number of continuing education hours per year to maintain an 
active dental license. Funding sometimes restricts opportunities for officers to receive training. NDCPH strives to 
provide the maximum in training opportunities for all employees. In figure 7.3.5, Lieutenants (O-3) and Lieutenant 
Commanders (O-4) are referred to as “Junior Officers”. Commanders (O-5) and Captains (O-6) are referred to as 


“Senior Officers” 
Metric: Number of Physical Readiness Test (PRT) Failures 
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Figure 7.3.6 

All military personnel are required to take semi-annual Physical Readiness Tests (PRT) to demonstrate acceptable 
levels of endurance, cardiovascular health, and flexibility. Civilian employees are not required to participate in the 
testing but are invited to participate. If an individual fails the PRT, they are given the opportunity to improve by 
participating in NDCPH’s Remedial PRT Program. Data was not available for the second PRT cycle in Fiscal Year 
1996. 
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7.4 Supplier and Partner Results 
Althoush suppliers are selected using mandated guidelines, past performance of key suppliers has been excellent 
and without major problems. NDCPH’s requirements are understood and complied with by all suppliers.. 





Dental-Medical Recycling Partnership 
(White Paper, Newspaper, Cardboard, Cans) 
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Figure 7.4.1 


NDCPH partners with the Branch Medical Clinic on the recycling effort as medical had the funding to begin a 
recycling contract and both commands share the same building. The co-location helps in the management of the 
materials and logistics of disposal. 
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Figure 7.4.2 

As noted above the average supply order receipt time has dropped significantly since NDCPH began using the 
Government Credit Card to order materials and supplies. Decreasing the supply order-receipt-lag significantly 
reduces the amount of supplies on inventory and enhances materials availability for providing dental care. 
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Credit Card Use 
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6 Credit Card Use 
Figure 7.4.3 


As noted in figure 7.4.2, use of the credit card has a significant impact on decreasing order receipt time. Figure 
7.4.3 depicts the increased use of the card since its availability in Fiscal Year 1995. Use of the card was not 
mandatory until Fiscal Year 1998. Data for 1998, of course, represents use as of the second Quarter of the Fiscal 
car. 








7.5 Company Specific Results. As a military organization and a healthcare facility, NDCPH has several foci of 
importance to the organization. The following figures describe the more prominent areas. 





Metric: Man Hours 
Number of Hours Volunteered by Command Employees 
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Figure 7.5.1 

NDCPH combines volunteering in the organization and the Spirit of Aloha by stressing volunteerism in the local 
community and efforts to aide those less fortunate who live in Hawai’i. NDCPH reinforces the importance of 
volunteering by including it in specific employees’ award consideration. 
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Metric: Percent of Employees Volunteering 
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Figure 7.5.2 
NDCPH encourages all of its employees to volunteer both in the local community and in the command. With this 
new metric NDCPH will be able to monitor and review volunteerism from a broad perspective. 
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Figure 7.5.3 

NDCPH'’s facilities need to be at “the cutting edge” for dental care providers to deliver quality, above standard-of- 
care services. It is difficult to determine the Plant Value Replacement due to the number of branch dental clinics in 
NDCPH and the building ownership disbursement. Although not remarkable, figure 7.5.3 reflects a continued effort 
to provide a clean and problem-free space for employees to work. 
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Metric: Status of Projects (% Completion) 
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Figure 7.5.4 


NDCPH monitors progress with projects to ensure that improvement efforts do not stall and enthusiasm in its 
employees does not fade. When progress lags, senior leadership reviews causes for delays with the Operating 


Management Department Head. 
Metric: are Needs Being Met? 
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Figure 7.5.5 

The Supply and Repair Departments internal customer satisfaction is represented in figure 7.5.5. Those two support 
service teams were selected since they have the most impact on patient treatment. Patient treatment is, of course, the 
main vehicle to achieving NDCPH’s mission of dental readiness and overall customer health. At 86% of internal 
customers considering the service as either “Outstanding” or “Excellent”, overall performance in meeting customer 
needs should be considered above the standard. Information presented in figure 7.5.5 was tabulated in the most 
recent internal customer survey. Staff provided information regarding their satisfaction with the services provided by 
the NDCPH support teams. 


INITIAL DISTRIBUTION LIST 


Defense Technical Information Center .................2..ccccoccosccoccceccescesecsecececeeccssrenseeess 2 
87253 John J. Kingman Road, Ste 0944 
Fort Belvoir, VA 22060-6218 


Dudley Knox Library ............:-.2220 ee r 2 
Naval Postgraduate School 

411 Dyer Road 

Monterey, Califomia 93943-5101 


2300 E Street NW 
Washington, D.C. 20372 


2300 E Street NW 
Washington, D.C. 20372 


Commanding OCET esris lan o ee eee l 
Naval Dental Center 

1253 Makalapa Gate Road 

Pearl Harbor, HI 96860-5030 


Professor Joseph G. San-Miguel, CodeSMISM ir een. l 
Naval Postgraduate School 
Monterey, CA 93943 


Docelorkaul)sKıelds, Code DIVYMl..:...... 2 See nennen: l 
Naval Postgraduate School 
Monterey, CA 93943 


SSG Tesepwa Er, zlewicz, USA (Rei. or Pr... 5. -2-cncnceees 2 


700 Sherman Street 
Portage, PA 15946 


ve 











66 bie i 


6/02 27527-200 * 















































































































































































- e = 
e - 
<A aqua .. = 
an 
m ~~ a a» ` Ld » et -- = 
oa a td he ow x? Cr a - a E pe u de E A 
reem 72072 a anos e. . .-- Be os ates E o EO e N e 1 R u 
en A a es Bar 5 E $ . . o - . a 1000 = we > e. e. - . - » 
A dh RS - CS - .. > o» 0 -— ua nm A r 7 u = RE Pees f A z eS k- ae x 
TELLE ga qe ae ~ = “y =e ” - .. -« - 7 -.- A A A E > A x rs u Zn: : ae. = A 
See ee ee a Ts -. or u aa» Sa Me Ly e r = a Cree rir P} a . > Pata oso ry o - . 
er ae Sa ak RT ae rn ee a ja 7 E Hi « . “æ so - ETE TERT ine a - «4 Pe C .- 
een T - Ca - AO ... . ES ia o . Ln. » æ o.» a 2 Dur} . = fes x Pe Aer en e E A aes e © p a aes E = 5 
Sr ey DT re = rod DE a =- -. i i = aoe SE . A o C PI E Lp... e sae --. eng . PS ma .... 
LR Sp o Era = ee BE aoe a P os G Aa - Sir z 5 = en ASA SAS oar oa mean * CIT PL’ EI) 
ay en ie O A AS oe = Sr Y u Se = «a ce ... e. ..<.. . La ... . » E PA ETM 3 - 
Ca 5 nu. wu. ie teal e = -.- = -- PS .- o .. a EI Pa a . E J ER a: k E Ta E y A 3 os ie 
Sá s - A e A >. a AS Rn ES a z >= - - . Pr) o - er on - mat e Pre) . a -e - . o 
er ge or x Arts. Ze z a SR 5 os jj a i > j a o . Mn "os ry «me ese or >= o. « Pr} .. . . ln .. 0.» 
nos - .- æ as >» o-& ry e. as mn . -. . J -. 4 DE! g ae R .. E be i en E E 
dh Ti TTR T Be en x z a Zu - o . .. . RT [I © a . A A FL] . > An 
~ Pe PO EDrD -. =. - A ee ne) » e. ome% P” e. = a ñ f i le Ata te E iS O 
- AS AN pr ... ma #6 -.- = di = ar mre er ~ D m A . - aa m Pe - . Er Tr) Pe tid Pe ke -—e 
ind Aia ae A ze rae ee a a .. o. e ne Ag . - E g ... - = «= = = 0. . - . .. Coro CO nat = 5 
ge aad ance ET Er p a i = FA : ate .- .. - - Zk Py D A as - ¢ = .. . - s mm.» . A AE ne aso EO E T 
er ni am. y - . -= 5 oe ome z < N Pr A 7 z CS = . . 1 - a . AE Br “ya on E TS A TT ne 
2 emma”. er F ae Ber ER = a i za Zar ae -. u y ri z . a .. = .. .. | « ann A ... .. e. Pa CET] 
A A AA .-. E ad Dur ze mo Se ES eee Ss . = .. a .. = . ==. «te . eee y ORE un 0... . COTES er OS PRA . . 
A ene ee Reise or Sa wat ree A > H i E - o + - ye . - « « A ee) Jr... SS A E ee a4 . rd 
m. ur nm Pe Er Pe (zu A A he e = = 5 * . .- = . en 2.0. e ru we ... - = a . O] o 4 wes ..: 1... 11... 0 
en Es , Sr = moe j = J a Br te S si Tale = 5 re A = - .. ry f} - o COTE E CET ee Pa _o- = row ee a CEER ae) 
Secs AA TE AA o E 3 era i x z eS i 5 7 E e .. a > ab .. ~ .. CR O o CY a E - 20 e mr . a ~ r 
e. « M soas P.nos -~ - - . a CEE - ns Š A -s ° ra > Py ee æo. ad - C a dl y es 1. AA TN aes 
i u I < 2 ie E 5 peace j a : i 5 z ; "e a . CE ee) Er g ho. Per A A AA A A A ES mz e o - - PERLET » 
ha a ie a Coll aad Bean bod mm. m E j pic ne 5 aed i ts = - = - Py A Pac os . sınos A TA = CELE Zu Cr; 
a a > RR y ETA E p en NE y i ke ich 5 > K e Me . . .-.. . . * a 8. O - m - “vo. o an. -... . a CE EE OT T TTT ET 7 e. ¿ta --* [zZ 
A» Per ESG PER Re a e ld ao Me al pee Edy a re, PS EIN) n 7 . O PERE ES s eroana fuot,” ze .. .o e A A a 
ay ee ee ee ee d O NE ee en A er g o . ». . 2 D ~ A a i or - "100005 Zur ET Pr PT ee Der E E] == :ys 1 Ugo Pi PR 77 -a ua 
ius, a O ti aad eater Cp eg ARAS A A den che en a D x ee z > Sg . $ .. a Per Tr ee Fr ar nassa s Pe ee ee | A Tau A A see 
Ed oe oe te ee Pa A i a m qa o” „u... g mos >. FR A RR cn a - d A .. . . ~ -E 0 = => rr 2. e» .. ... eo AS AA A SE ee 
IT 3 s Ke in calas a Eh var Er Ser ch i . - F nd 2 Pe Dur 2 ad bd . e . -_ wwe Loan * s. q, ... AS seer e a [re IT Lts a a Le 2 
SE ER u...» >. . - . a Be ido = r . .. e. D = CO »s . -. TS aa m AS . .. A Ep DT er ee a er 
ATA 3 y A Ta on PRE NS Ta ea eE y ‘ eet 7 ¢ kd . y =e .. - . PTS a Pee ee ee) EEEE A ee 7 he pa 
AAA me A ps - Ca Er =. ... - = RR A “.o ...o .. new . > es e. .. o PA O ee Pr So) TES A ET TEN r “og 
ee ee da rra y et = T Feur E E ict ic e e Ex eae ee -è > I il = °, ni a . 0 mp o agao m e . PA m...” o "2a sum LI u ..—.. 0. 
PI AAA AA TTE ..> A 2... E La a ba =. mzs m 5 a us Pr} s a a MAA TAS DT} Ir} . AA A m e 
RL a A NR -.-- - . - = le hei er EN p ° ~ ° A s. 2 » . a . . . 1 CA ...- u ys ao. o 0. AN IT 7 E A 
ae A O PA -. -.. = Bet at el JE : be ce Se pass >. - » . ER . re - -.. f ... . FR AAA AAN O ee 
A TS Y O A Ne AS - u. a "T D .- En De r .. Sry ae on ay ry "T E T) ore ow = “a E aaa er 
ee he aay or rice ee ES ` 3 Dr Tore: a x u Se = °° e a >. . o = ae . EA - a. . .. ok, Ak . . 10 . . = (sev (Mn La E ds - Dh . a a a a 
A E Bil = 5 E y . - . A O E eee “= N eee Para DET ee ee ee T Lacio T 
Er T pp ae re = D ot. mt , a * u ... Pr | ar g - = De e. e... Da CE r TEET ee) a 1 ee ee et er’ 
AA AN AS ES A tl „ne. - ..us nl Er A e a omy ..r AT 3 pei j y S Fede Seat E en a CESS oe > d de nn) j 
rn ee ee eg je au var Per d ° ~ “~~ . Y Si: oe ETE » - e a ry “r * [pr r = a -. . PT] O A Ze 7 ee ey A 
errr | ae ae 7 PES E er nn cn. q i = ea = ea e. .. . -. « PTEE TETEE ng ia. et ee an ae so. 
A AAA AA A A un rn nn E ia . tgrubhos 0 > ER uns - 40 e ee er 7] ES y y A 0 Der} nr ee Ta Te m PERS REDE A A 
nn En nn u er Ye aie tee ete ATi oe a oy) Alec rere Go er) ee O A ere PAN ers rar ae ar ns na . 
AA 7 A QA UA AAA o A A AS . C . a o- . - 10%. oa vot rr - Pe eee ee Ben Pew © apa o PA AA nt re 
A A o 7 Br IA o A MITA di Sis we. y. re = u. - -_ " er ee Se coi ee ee ee a ee ee) 
ee, © er ie Ka a on Fu Zr pl b. A CEO TE E] g me soja. os PETE ee ee a AAA A E ere 
rer ee eae gens x -. re . o. . .....is ..o. “mn . .. me PE A er AAA TA A A ES ...n 
A E EAT A AS .- = ER A A A . . PO eo... a +... apo r eb E Bine ARA ee rr 
ren er N or En) . 3 o D oon Ce ee, Ye "06 8 Cr ES » 4 . nte e. 
= A a en ee u m ee ee ee) Hr up - . PA “nu 0. Pay) ee TE TE A ST nt. 
>. P Weeze AOS a er ee = . IO a =, SWA © P . Fr e« cE 2.0 482 E PRA 
A o si TNA AT ze AMO | Led Ren e , = G . a. PE . n D PO o. ack - @ wate = ee ee ee 
a eee ee E bss a pipa m at mm at. e AE = f, un . 2 . D O PT C .» .». mo. . IS | PEA AA E a PS ATT Zee 
A A A A NA i a: ar y e TT? AA E 0m AA A do Rd 
nd ¿LO mos T ur o ze or) La ate. <P @ oF © - „su...“ m e. .-% 0 A PA IC EA Cen wet ELET A PIE TT] TEA te u ” + eb m 
ee ee AA ore Cas Lda lic ied . . . me a A Fra aptos wo. ETA E AAA Ir A PRE ETTE TA E 
ee ee E NES m. und“ Le ro = E or? - » A - ..o = A æ o e | ... . .n $.» a -. PR RT O pi 
A A is id A TE A y E = Tasse r a . “, An nn © er p O - 44% TEF Ber TER e PATA Pr er La 
OT ir AG = ere - oom a PT 0 ne PL A ee ee AN AA 
AA AE SAO . o - . OR .. >» . =- o A a. A AP es ee ERT RETELE. AAA da a 
o A nz A E un, ra = te ca a Pr Ten ee ee ET Pe Oe ee] wen ann re 
A GO re j RS ar ke e... ms .. AP A TA AD] 
A A A E A yos ate na s ene TENT TR g de # en meer 
ne ee al A ee AO A BE Ba ele ee ul ern CF endl en IA O A CS tum man ._ wn de Yo n A Ss .. .-.. e A 97 2 
er - ee A ae eth otal td a. a O - eee Pr Peery a ahd o Pr} g A = ae. "A “ 7 rages a A eee oe 
A a de o IR laa ace et Md ae ct E de dae PE A A 5 D a o s.. „a Pr) ha» ern Er ur nn E et 
A nm en ma 80 us CESTE E e E . ” A « fun ` e. = . os TO T T TN T 
s na er Le he Bee es = a Een aa eat A “mu we E a -- e TE Lo . . . m PETE ..._ u. ERRET : 2 von tr ima Am re ie Tat 
” A O . ms .. . a...” g . mn .. .. o sor Cr P . sto P} = .. o ... PI e E er A a dd] 
- > e. nm. Bue ea A Er A . a . e. ® + ee Te Ge mam ae Der} A . pq A A ee a EEE we ige 
ee een ANA „er o o Ltn ag . „> . Du A 5 .. NAS o .. ..- . ten Er 
ea. a ek k E T » oie PN PRA Fer f En a nE = es f k es k 
e A A rh ER a ia ee AS CUL 2 » ” o - bd CE ue * a r ~ a pa A ~ e...» 
PA TS o ne .. -.. te lide SL a A Di n ° =a . o a dee m ™ e “nn 00m > a . . om oe ow o 
o A o ad A A ee a E A ACI SEE E? um... t C er e» r Cron z u. EP mn em eer tre rt eet aes 
A KA A o o De ee mas een AS ES sa ° e da . ... op. wre - € se or . E TE ee Der} Pr er Tee 
= = AA AA RA a ii . e... As vw anie a... . .. E 0 - o » A 2 eo æ ~se - - v .o- ® D AA AAA 
A ae un . .. = - u be! Hd a a A a Jo” =e = TEE es ur ese -. cr .. a ES . .. e... ir 
AAA ES Pe AS 7 A Be Tr Be 22 a Sio a >”. q... 2% .. =» 4 =. > .. y a. , P | ° at ae , A = RER, a 
= AA AS > =. a suo . [halted TR eal e E .. D M . o - arme Pr} a a = ry ae Py sone . “aa 20 duty 0? ee td up zer 
—t EEN ETER ee a SI or ne Cy rt? rn ree om ee A « a . . ny a nr ea. ee um a A Pe er ee FE NT SE SENT BESTE TITLE PET di 
— — | A AA TEATRE -= Co a ao A Fee PS .. 9... pa g ..._. a m a 5 er ate ent De A ER rs ee A eee ut 
ER er AS -h .. 77 ..uo .. e v Fl ~ N Pr “a Me ge ” oa . m . mos. Hu oe > FO AA —.. A A Di A Try 
- an A =~ eet >» = e =e = A D OPER?" fi e A A e Oa EE Per Pre a un Bd Ta TR a id 
- —— A A Tr DEE) mn II TS ze" ee Ps =. e= = RE — te A er s a an : i nn. 
Oo n Ã— —— Hae T aaa - N nu ee 0m -© © = guv.e0t « o Du eos? Ser ur? CS yr os ee ee ae =r ao at O sept eo £ 
XL o ( Y ) Her AO 1.» CE 10:90 le e e .. ss » n ess = g Pre A f r TrA se a 7 2 . Se AS 
Sa mn ui SS en e he seem ad ... ur ES A ur Ale = m . vun - 2 er aT) ee eT | .. not aa OS se 
— — un DE ar e Ono o PS -.. . e 0. à > ou w eo. or ee © © oes mm e o Fi e* .... e ae Be ear A a 
~ m amma = E ` . =. 4 ..... ¿4 .. -. 9 g OP ». .. A e. -te .. nn . .. Pere ee Ds Pr} A ES Ma IA IA AA A A A ee re | 
= N A A an me a 2 m PA O AA teeta 2. .. 0. A - ct . ” . mp y Tp . ae 1 we - o. . . 2 wes ow CETT een at ae PRA A r a 
— — is ed A Di 2.0 Ses 8 e” rm” NS s De Cu A Mn . ss» .. . ° g Pp Pro Dur ur p Per e E ATT A Oe 
pean O AA PR ee E A ae . mo. eo eo T e n A g Pray e... 8 - » Pe eet tT PP ee Ze Od ad ok PETE PR reeled S 
= PELD O ES . Pr . , . ô ee LO . ». .. 1. 0. + o - » . Prt 7 DETI A A A PE A E E PG 
yë PD < .. E E E r bat ... ee EN} A t . .. -.. ae 4 . PA ~% e .. E of .. soy - e dadas a od a 
e E u ee A ae te x ‘ e ar A a e bs = y “es mae er er . be cree M8 98% ee saa -7 o AA E BET RR PIE Der a AAA 
O De me ni ame o ~ eos a mn. oe a PP ee T = err .. u... DIRT?) oT ao 099 AAA IN qa |... 
= BE re A Tuudeter ea NP AR er 777 ar wie ae wie tee eee A lern) u te sù . DAA A = m payee Te 
= on be apa ee un nt Re Tide TR De w å u .. a... e ae .. A . eo... . . sua e .. PT TI a La yl Se pa RIP TE SI FTP Er pp prom... 
, ¢ ) OS A E sn ev dry AAA A A + = se. oH A om. 6 A ER Ape ete er‘ green un 20 9 pra Por, feet eee Peer AS ms par 
ps EAS PPE A AA a i a heeded Fr -. A o e. E bn 4 u * = ° Pe . «e > eo... -.. = ae CE ETET] A td AA AA SS 
A is Di rad es...» AS Pr ~ pe w AS Tr ... 1. - e... . mo -o e. PL => sas a Lagar y te A A ta 
>= am yn mu u mm 7 A A ii on ee r s% . s A s. IS AA . . ge D PP ee oe .. © mp A mat aÈ EEE Eee 
— Cl ) TS Lts el ead men manme Ct 57 u 2 zu Preity er” + tora A A "se WJ . “e eee ee - * [22 772 .» CETS . . . A A E A AS II E TN A] AA A A AS AA Zus nommen A SS 
= — CO A eh as rh as De eh I Mi hel a thes ed “ AR > ES po. oo opa ee e ee a o PER, ” a “2. .. 0 um... e... en A AI AA UA O DU Amo rd 
-) a A A A en Te ell bane po . . o F A be DT . TT MR T ET STA e da ee Peer tira 
sumo, — RT AA E el id ely oe ger & y Pr x Ka P un 10 Ty . r 7 .., mo ANAIS TE Ten A 
HQ a lib ler Md a po a... CFTE P ng rs “nr T 
= TREERE A o la Com A Related A CL DT å ed ee n roe ey oy 21000 ña 
zw ( W O A a Aa ds pa TTE TT A - armo r rd oe A ee es 
"~ PeT Paa AA et T T T CLET T « erin ol Peel) AAA AE RN id da ol .. 
u ——n., ee, P ARN a A A er tel IE - .. A p 
! eo « €e 8 . eet Pee e dd ey 
= it ) noch e ate m... 0 TETY E 
des e e 0 un es ee ene ee Pte nennen Warren Anne 
A A A AA IT ee ee 





ee ee et ee eee 57 7 aa 
ee eee ee ee A a a 
ON ae EL IT Dee pr en SL Lied tat i ld 
A A ee ee SEI 
un eh all Lee a nt 
A ATAN A | Pri 
DS a o e e bd 
cn ee ee 
al tad dit el ae tet PET i e aa 20 22 

EET ¿A A A gr T 
p Sit TTT eo ee el ey CN a a 

A A a e =. 
arte meer Pe 6 u TE , 


Da) . . . -= .. ... . e. “an ATT ETE FT? - 
E led | Ca 4. A 


EAS 


E PET 
ro” e po 
ES Pr} 

PER 
-=+ 
baa moto „a ne 
Ad et ee 
A E 


Pai o e A rr 
MAS A 
. on 








CoH DBLP oe har TA 
E xe OTS 
ee 8 TEN r - ... 











uE y O AU a 
dal ARA A is o eed 
A A AA E A de kde 
A o O 
K demo A AO es RAR cid A AT En 
o tater! PRA de E A a A AN PS 
A A 

























CETT ETT 














ee S, a a re ee r T T dr ind 
dl La th lie) . Pa AA A o 
A ale atin pee den he a ed a ~ aT TETA an 7 A A a ct Bed a 
Arcos e ogro aida o ee Pr ride aaa rE Cs ths baled A 2 ar A AAA LE al A Aa a 
Pi a aeaa A TS aa aaa a A T AAA dd D Pf .. nam 0 E ale da 

s CEET] «214 eto O 








A eee 





A Splat a ech oe eek ee De Ze ee See nz 
A AA 
















































ndo o A A ii A SS 

A a de Heeres Fa lee e E 
el nn Ta een ne LT in ET o rm PT AN TA . e. un AT ee Oy el [A eet tet ee 

eS yate ee ee di A hd AS ad dl 

Me AA A ss AAA AR A o ». .. » r =e narre A a En Ben een 
ee eae Kaa a DD er T er ed) DT u Da me A Pe ee th eel et E el ted 
ee an m a er mann eg ee Se e a e— 8686 Oi dn bene oe genau « e... A A ii titel 
a TR a A 7 AS TIN ree eee a y CALLE T ER TT A A ee a a a 
A A AS AS par TIPE AS ayi di ad 
A Bd ee a ee ee be ete tae IT MORA . A por Meal E s3 K o a 4 ont ES RR? 
LA ee N nm = unge Br pre nen zen ..— E “N man e -. PT A a o a E e te 
mea A AE en A A E 0 Seed te he a a ee ead Pe Pa 2 Og 8 TN LIA A OA A A el ll 
A A A A A A A a a ii au . er Pr es ” A T AN A A A dd m O AAA ee ee 7 or 
A es tela eed P . pmelp g . o -pto nat Prato SI A A ee Eye er 7 
aa = AO ANS A a de  eı 


A a aada idol 
e... A a a 
A di a e dd 


di la 
AA AAA A AAA ii 
A AA as a e DE En A el 


vo e. e 





TE E 









TE EE a a ai dd 





lores 


DAA CN A T LIA DAMAS A LA DD NAAA AL DATO O uch Per 
men nenn Teen Bad sala ed gate tee a th ne A A o >» Fo ur? = a a EU o mcrae |g 
PELTTL ZZ Peet ae e a ey rs nomas ee p y AN GALA 

A SR e a aid 





A A A act lh eet al eI teh het radon hott tebe ie ag eta 
Y AR ee 


A A n S | 
I ZI We CE Er pe TI DI ES, 


makasin auat ai u anion e bd ani ar ee 









i et wroteon 













































De ee AAA A E a aie teenie 
DE alia, o a a nn De hel nt A A AL] er ITTE TE T & ue 

o ee aha e OS ch 
nen On BEE ER nn tal Ti Pe ee ee ee tT a Y E E E EPA ee er A AA A A TER ee 
rs or x Biter asia a aaa dr a ere on ee ers QUAY 18 mee Tee PEA TIN PA MU AA A ASA ERRATA 
A A OR TA A Cee ty “ale “iger = race ot ieee ee A o dd 
a a cl ds dd tis veo ahead ieee Pod danes PT Eee AAA RA FIT FT en Eee 

were 7 Zu UI TE ZU 





PL Se ME alt tah a a ee RS ds Bee eh ee el 








A pe a pr pana E rer [IT TEY TELCEL LITT De Ze oe er .s 
Sra Toa EES pr Je ee re ARNE Oe ST TT 08 = . .. o E a ery us im e er, CS 
DA A AAN The “a A A . siinne sime A r 
ee N ee id ando rra A a A O E o. 06% al AS TE DE 

ty Pe Oe et ee a 





EAST 
ere TT 





"0 y 



























































































































































A a E E Pekan PTS no... o. . a TA 
E A A Dr LI 252 E y 5 i A . E g TOTEE CTET LOD ERRA ea A: zer si Pat 
A el id e. . ur hord : Pubs 4 -- 1 eu PIN p e esk o. AAN A E a a PO 
DO O A AAN A ee ae er Pry eee ee | Ran ar re RR » eh he te ee A Em RE ED e ET OR ne N 
is da bir Dc eS ETTE a nr A e... » el Po. E tr t; A G take we » .. Or, eo eT) A a aLi A da dec dd id en 
a Ppa te tr ee ed ied bl i te iu a Pe ee eer ny Pee ee enn ee Peer ee es Se II ert ee eet ene ee Pe aw Pr} PET PP Poser En AA ee td IE O IA CO AO A SI a 0 a 
A a a a RED. a cepto. ¿Pants CLT Be Ir ? . tre ee Md? er, G . ae MINAS @ PP o ¡ey o A ee ee aed SN ARS EN AA Dn 
A tied, 1 a ana aO aa aa aaa I tel eine Er ZEITEN Ey} A A AA ar “0. ud > TETEA >$ yo saot e E AAA eh had A ee a he a) dd «pe o ici Le aat, Le del dai on... chet tat male 
Fad le at ad PO AID sage ne aN EA EI BZ Tr Bi A FF PL Re Pe e 4 e her vote A A AT mt a AA on. A A ee 
ee rer ee A de aa nee e ar e N A i a en een‘ 
u TEE re cz ET u Ag arte A A A AA ed led PST CER) e..q4 0 ¿eb a A > e. up . ig 
oe Sea E oro er ren Serien O rar A A e as A T EPA A A TS A 
a pl dl e e e, C e 2 3 „te PM ala ee ee 7 TS E OS 1. -2 .. a se a 
A pt rd A olas then eevee a ee A 7 E g .. [PIE Pr Fa Peer rr mer rrr yr) Perr Pore Ts Set se re T Ir 
en are ode Peine er vonder ea apolar Readable et p g . DV TFT TE Pe Pere Me ga? 1 vm e 10. ga» .. me: A T 
5 ~e A a a ee ee Oe a wer A TTET w 7 0 26 .. E ry oa e th ke err) rr) 
ee ef. ir dein > po ir De DA Pe eer yar arate ere ene UA AAA A RER are re + es te = geet 
a mn an aaa dh om thon a tt len ok eh dened u An = r £ n P TETT eS Por) s... œ e as me, Eres 
a o a Ki ha n a ebene lang urn m Rt Tn) ot hab tet E ee - s. A MA A AT A IA a e De tend e UI Y a 
a os ms o o o a a eee P rime nord) om oe on... A AA ee il ideas SR A da dd a 
O O ee A A Ad e A A A) ea T AA A TE AAA AA APO bd nd 
= LI een E a a E aa rien AA SS di ar a E EA OA . To we GT BET PT 7 er to KEPP T A PRES RT AS o a ibid bestia PA et E da 
a o o e o A dl iio tae AA A AS E rer TI | Rake, we Pur AAA A AE AA RS UTE o ir to PT eee dade oras de lol a ia ln 
A a aa aa a ann A ia il totale Sea e... aot ror a il NATTE ESA FOLD PETE aee TT A DL y Jo ... 100 Ss .. AAA A A id DAR emana A is aa oh N ded Panpa all tae) 
U EEE In ROTE a dl ER DEE Dun ET : x m > A A A ATTE A ri rl dd A o ad did 
E ge! o ll lodos En ode AR Pao ¡IN A A AAN TA ed S a aA a ee T PPTI A ee ee o 000 am PS Le ee ii de O id i hd ol oe 
or a ei cido TA AA ol Ay A E e AL i er Vo | po? A A id dd cie 
FT er a E A P TTE T TT onde ote? rant Pr ER PP OT ER et E se r A A dd ds dd El os nd 
A En I O A O A e e emule Atari 0 Sonn "iras tes RE 4a en ee bes Pr" so DE me Tr Pe Pr re ne ic ed da ita a AA dd 7 
en men A e A ld alto pi Lol cinta TEELE ra n a e FR Ma n AS ra S ee ery r ARA TAS ar a d 
3 . el a r s aa O ELITE dl a) E 277 g . A o TE at e Bee if RR tes cheered pea need dace on 
a AN PARE nae PY Tee e. q. munter DA e qe - we, iss CTET zo ee ee et oe ee LIE eb 227 er 
E mane tomcat OA ana SA O .. em TS . as o otun y PETTITT se «e SS E) TN © OET T rt od ae PERO JS O YAA O e e ee 
A cane ne hey Dah chant eed ee ee ee ee ee bles ach bed tat dh SA . aa LET PT PETE re. A Ss Be on . Tas warnt ee ene do adn Al ated tend aa ae © 
TDR DIETA Lim, do q, 0 eh ene) CES PE Or ee ee rs Th el bh ae eed id bee, eal GEL ee wea ae) one es Me fe ee ee oe ee | ee ey Pe SR ee . A AAA A A A ido a a db ia 
nai ica De e o, Jer dd A SAS rta E PELI Ir od re STOLE ee Ayo de te FS er" A evens AEF AT ss. n a were er A A AR T aaa aa aaa 
nm ny a iaapela eae a RA pe aaa e ii a aali a Sela "rr Tre er ae e y A A I a Da AAA dr di 
u. ns u De ee odor ote baa asian eam Oo EA a ee ee E ho: ¿art . par =e on PA oe AAA A 2 
un AN TRETEN ON HERE EL ER SEE Pee bade Yoke oie oth Mela ió eal Een HPA p a opr Si, et 
Aaina a, aLaaa adaa a oa iaai a A ASS A IR 7 2 A ASAS O ANA . E NN 
rr o TR aa a abt A AAA AAA TA Naar ng € A A . so. % e 
APSR damsel nae 2 N KA PR a > 3 en O n ; 
D a * of ere wy 1 A on far Due 277 epo PTS © ° a 
2 DE UL. CT © © @ e ee E? egor of me MATES T” 
EO TTT . rite eee a ee e. a A od 
pan a Pre N "UT 


